Error when trying to ingest 2023 season

[peterdang1502]

Hi there! I'm trying to get involved to start contributing to this project. I forked and cloned the project on local, started the MongoDB community server, set my Mongo connection string env variable to the one specified, and I'm trying to run the below command to just see what the ingestion process is like (assuming it is fetching and storing data about the 2023 season, I want to see where it is stored because I'm unfamiliar with MongoDB at the moment). After ingesting a couple meetings, I ran into a lot of errors. Unsure of what they mean, and I can attach the full log in the comments. If anyone is able to get a successful local instance of the project and can provide any help, that would be massively appreciated!

C:\Users\Peter\Downloads\opensource\openf1>py -m openf1.services.ingestor_livetiming.historical.main ingest-season 2023
2024-11-27 15:34:35.325 | INFO     | __main__:ingest_season:389 - 23 meetings found: [1140, 1141, 1142, 1143, 1207, 1208, 1210, 1211, 1212, 1213, 1214, 1215, 1216, 1217, 1218, 1219, 1220, 1221, 1222, 1223, 1224, 1225, 1226]
2024-11-27 15:34:35.326 | INFO     | __main__:ingest_season:393 - Ingesting meeting 1140
2024-11-27 15:51:30.602 | INFO     | __main__:ingest_season:393 - Ingesting meeting 1141
2024-11-27 15:59:26.801 | INFO     | __main__:ingest_season:393 - Ingesting meeting 1142
2024-11-27 16:06:55.373 | INFO     | __main__:ingest_season:393 - Ingesting meeting 1143
2024-11-27 16:14:51.025 | INFO     | __main__:ingest_season:393 - Ingesting meeting 1207
2024-11-27 16:22:08.948 | INFO     | __main__:ingest_season:393 - Ingesting meeting 1208
┌───────────────────────────────────────── Traceback (most recent call last) ─────────────────────────────────────────┐
│ C:\Users\Peter\AppData\Local\Programs\Python\Python313\Lib\site-packages\urllib3\connection.py:199 in _new_conn     │
│                                                                                                                     │
│    196 │   │   :return: New socket connection.                                                                      │
│    197 │   │   """                                                                                                  │
│    198 │   │   try:                                                                                                 │
│ >  199 │   │   │   sock = connection.create_connection(                                                             │
│    200 │   │   │   │   (self._dns_host, self.port),                                                                 │
│    201 │   │   │   │   self.timeout,                                                                                │
│    202 │   │   │   │   source_address=self.source_address,                                                          │
│                                                                                                                     │
│ ┌───────────────────────────────── locals ─────────────────────────────────┐                                        │
│ │ self = <urllib3.connection.HTTPSConnection object at 0x00000259CF4A8690> │                                        │
│ └──────────────────────────────────────────────────────────────────────────┘

[peterdang1502]

full logs:

┌───────────────────────────────────────── Traceback (most recent call last) ─────────────────────────────────────────┐
│ C:\Users\Peter\AppData\Local\Programs\Python\Python313\Lib\site-packages\urllib3\connection.py:199 in _new_conn     │
│                                                                                                                     │
│    196 │   │   :return: New socket connection.                                                                      │
│    197 │   │   """                                                                                                  │
│    198 │   │   try:                                                                                                 │
│ >  199 │   │   │   sock = connection.create_connection(                                                             │
│    200 │   │   │   │   (self._dns_host, self.port),                                                                 │
│    201 │   │   │   │   self.timeout,                                                                                │
│    202 │   │   │   │   source_address=self.source_address,                                                          │
│                                                                                                                     │
│ ┌───────────────────────────────── locals ─────────────────────────────────┐                                        │
│ │ self = <urllib3.connection.HTTPSConnection object at 0x00000259CF4A8690> │                                        │
│ └──────────────────────────────────────────────────────────────────────────┘                                        │
│                                                                                                                     │
│ C:\Users\Peter\AppData\Local\Programs\Python\Python313\Lib\site-packages\urllib3\util\connection.py:60 in           │
│ create_connection                                                                                                   │
│                                                                                                                     │
│    57 │   except UnicodeError:                                                                                      │
│    58 │   │   raise LocationParseError(f"'{host}', label empty or too long") from None                              │
│    59 │                                                                                                             │
│ >  60 │   for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM):                                    │
│    61 │   │   af, socktype, proto, canonname, sa = res                                                              │
│    62 │   │   sock = None                                                                                           │
│    63 │   │   try:                                                                                                  │
│                                                                                                                     │
│ ┌───────────────────── locals ──────────────────────┐                                                               │
│ │        address = ('livetiming.formula1.com', 443) │                                                               │
│ │            err = None                             │                                                               │
│ │         family = <AddressFamily.AF_UNSPEC: 0>     │                                                               │
│ │           host = 'livetiming.formula1.com'        │                                                               │
│ │           port = 443                              │                                                               │
│ │ socket_options = [(6, 1, 1)]                      │                                                               │
│ │ source_address = None                             │                                                               │
│ │        timeout = None                             │                                                               │
│ └───────────────────────────────────────────────────┘                                                               │
│                                                                                                                     │
│ C:\Users\Peter\AppData\Local\Programs\Python\Python313\Lib\socket.py:975 in getaddrinfo                             │
│                                                                                                                     │
│   972 │   # We override this function since we want to translate the numeric family                                 │
│   973 │   # and socket type values to enum constants.                                                               │
│   974 │   addrlist = []                                                                                             │
│ > 975 │   for res in _socket.getaddrinfo(host, port, family, type, proto, flags):                                   │
│   976 │   │   af, socktype, proto, canonname, sa = res                                                              │
│   977 │   │   addrlist.append((_intenum_converter(af, AddressFamily),                                               │
│   978 │   │   │   │   │   │    _intenum_converter(socktype, SocketKind),                                            │
│                                                                                                                     │
│ ┌──────────────── locals ─────────────────┐                                                                         │
│ │ addrlist = []                           │                                                                         │
│ │   family = <AddressFamily.AF_UNSPEC: 0> │                                                                         │
│ │    flags = 0                            │                                                                         │
│ │     host = 'livetiming.formula1.com'    │                                                                         │
│ │     port = 443                          │                                                                         │
│ │    proto = 0                            │                                                                         │
│ │     type = <SocketKind.SOCK_STREAM: 1>  │                                                                         │
│ └─────────────────────────────────────────┘                                                                         │
└─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┘
gaierror: [Errno 11001] getaddrinfo failed

The above exception was the direct cause of the following exception:

┌───────────────────────────────────────── Traceback (most recent call last) ─────────────────────────────────────────┐
│ C:\Users\Peter\AppData\Local\Programs\Python\Python313\Lib\site-packages\urllib3\connectionpool.py:789 in urlopen   │
│                                                                                                                     │
│    786 │   │   │   response_conn = conn if not release_conn else None                                               │
│    787 │   │   │                                                                                                    │
│    788 │   │   │   # Make the request on the HTTPConnection object                                                  │
│ >  789 │   │   │   response = self._make_request(                                                                   │
│    790 │   │   │   │   conn,                                                                                        │
│    791 │   │   │   │   method,                                                                                      │
│    792 │   │   │   │   url,                                                                                         │
│                                                                                                                     │
│ ┌──────────────────────────────────────────────────── locals ─────────────────────────────────────────────────────┐ │
│ │     assert_same_host = False                                                                                    │ │
│ │                 body = None                                                                                     │ │
│ │             body_pos = None                                                                                     │ │
│ │              chunked = False                                                                                    │ │
│ │           clean_exit = False                                                                                    │ │
│ │                 conn = None                                                                                     │ │
│ │       decode_content = False                                                                                    │ │
│ │   destination_scheme = None                                                                                     │ │
│ │                  err = None                                                                                     │ │
│ │              headers = {'User-Agent': 'python-requests/2.32.3', 'Accept-Encoding': 'gzip, deflate', 'Accept':   │ │
│ │                        '*/*', 'Connection': 'keep-alive'}                                                       │ │
│ │ http_tunnel_required = False                                                                                    │ │
│ │               method = 'GET'                                                                                    │ │
│ │                new_e = NameResolutionError("<urllib3.connection.HTTPSConnection object at 0x00000259CF4A8690>:  │ │
│ │                        Failed to resolve 'livetiming.formula1.com' ([Errno 11001] getaddrinfo failed)")         │ │
│ │           parsed_url = Url(                                                                                     │ │
│ │                        │   scheme=None,                                                                         │ │
│ │                        │   auth=None,                                                                           │ │
│ │                        │   host=None,                                                                           │ │
│ │                        │   port=None,                                                                           │ │
│ │                        │                                                                                        │ │
│ │                        path='/static/2023/2023-05-07_Miami_Grand_Prix/2023-05-06_Practice_3/Position.z.jsonSt'… │ │
│ │                        │   query=None,                                                                          │ │
│ │                        │   fragment=None                                                                        │ │
│ │                        )                                                                                        │ │
│ │         pool_timeout = None                                                                                     │ │
│ │      preload_content = False                                                                                    │ │
│ │             redirect = False                                                                                    │ │
│ │         release_conn = False                                                                                    │ │
│ │    release_this_conn = True                                                                                     │ │
│ │        response_conn = <urllib3.connection.HTTPSConnection object at 0x00000259CF4A8690>                        │ │
│ │          response_kw = {}                                                                                       │ │
│ │              retries = Retry(total=0, connect=None, read=False, redirect=None, status=None)                     │ │
│ │                 self = <urllib3.connectionpool.HTTPSConnectionPool object at 0x0000025A9F7D42B0>                │ │
│ │              timeout = Timeout(connect=None, read=None, total=None)                                             │ │
│ │          timeout_obj = Timeout(connect=None, read=None, total=None)                                             │ │
│ │                  url = '/static/2023/2023-05-07_Miami_Grand_Prix/2023-05-06_Practice_3/Position.z.jsonSt'+4     │ │
│ └─────────────────────────────────────────────────────────────────────────────────────────────────────────────────┘ │
│                                                                                                                     │
│ C:\Users\Peter\AppData\Local\Programs\Python\Python313\Lib\site-packages\urllib3\connectionpool.py:490 in           │
│ _make_request                                                                                                       │
│                                                                                                                     │
│    487 │   │   │   │   new_e, (OSError, NewConnectionError, TimeoutError, SSLError)                                 │
│    488 │   │   │   ) and (conn and conn.proxy and not conn.has_connected_to_proxy):                                 │
│    489 │   │   │   │   new_e = _wrap_proxy_error(new_e, conn.proxy.scheme)                                          │
│ >  490 │   │   │   raise new_e                                                                                      │
│    491 │   │                                                                                                        │
│    492 │   │   # conn.request() calls http.client.*.request, not the method in                                      │
│    493 │   │   # urllib3.request. It also calls makefile (recv) on the socket.                                      │
│                                                                                                                     │
│ ┌──────────────────────────────────────────────────── locals ─────────────────────────────────────────────────────┐ │
│ │                   body = None                                                                                   │ │
│ │                chunked = False                                                                                  │ │
│ │                   conn = <urllib3.connection.HTTPSConnection object at 0x00000259CF4A8690>                      │ │
│ │         decode_content = False                                                                                  │ │
│ │ enforce_content_length = True                                                                                   │ │
│ │                headers = {'User-Agent': 'python-requests/2.32.3', 'Accept-Encoding': 'gzip, deflate', 'Accept': │ │
│ │                          '*/*', 'Connection': 'keep-alive'}                                                     │ │
│ │                 method = 'GET'                                                                                  │ │
│ │                  new_e = NameResolutionError("<urllib3.connection.HTTPSConnection object at                     │ │
│ │                          0x00000259CF4A8690>: Failed to resolve 'livetiming.formula1.com' ([Errno 11001]        │ │
│ │                          getaddrinfo failed)")                                                                  │ │
│ │        preload_content = False                                                                                  │ │
│ │          response_conn = <urllib3.connection.HTTPSConnection object at 0x00000259CF4A8690>                      │ │
│ │                retries = Retry(total=0, connect=None, read=False, redirect=None, status=None)                   │ │
│ │                   self = <urllib3.connectionpool.HTTPSConnectionPool object at 0x0000025A9F7D42B0>              │ │
│ │                timeout = Timeout(connect=None, read=None, total=None)                                           │ │
│ │            timeout_obj = Timeout(connect=None, read=None, total=None)                                           │ │
│ │                    url = '/static/2023/2023-05-07_Miami_Grand_Prix/2023-05-06_Practice_3/Position.z.jsonSt'+4   │ │
│ └─────────────────────────────────────────────────────────────────────────────────────────────────────────────────┘ │
│                                                                                                                     │
│ C:\Users\Peter\AppData\Local\Programs\Python\Python313\Lib\site-packages\urllib3\connectionpool.py:466 in           │
│ _make_request                                                                                                       │
│                                                                                                                     │
│    463 │   │   try:                                                                                                 │
│    464 │   │   │   # Trigger any extra validation we need to do.                                                    │
│    465 │   │   │   try:                                                                                             │
│ >  466 │   │   │   │   self._validate_conn(conn)                                                                    │
│    467 │   │   │   except (SocketTimeout, BaseSSLError) as e:                                                       │
│    468 │   │   │   │   self._raise_timeout(err=e, url=url, timeout_value=conn.timeout)                              │
│    469 │   │   │   │   raise                                                                                        │
│                                                                                                                     │
│ ┌──────────────────────────────────────────────────── locals ─────────────────────────────────────────────────────┐ │
│ │                   body = None                                                                                   │ │
│ │                chunked = False                                                                                  │ │
│ │                   conn = <urllib3.connection.HTTPSConnection object at 0x00000259CF4A8690>                      │ │
│ │         decode_content = False                                                                                  │ │
│ │ enforce_content_length = True                                                                                   │ │
│ │                headers = {'User-Agent': 'python-requests/2.32.3', 'Accept-Encoding': 'gzip, deflate', 'Accept': │ │
│ │                          '*/*', 'Connection': 'keep-alive'}                                                     │ │
│ │                 method = 'GET'                                                                                  │ │
│ │                  new_e = NameResolutionError("<urllib3.connection.HTTPSConnection object at                     │ │
│ │                          0x00000259CF4A8690>: Failed to resolve 'livetiming.formula1.com' ([Errno 11001]        │ │
│ │                          getaddrinfo failed)")                                                                  │ │
│ │        preload_content = False                                                                                  │ │
│ │          response_conn = <urllib3.connection.HTTPSConnection object at 0x00000259CF4A8690>                      │ │
│ │                retries = Retry(total=0, connect=None, read=False, redirect=None, status=None)                   │ │
│ │                   self = <urllib3.connectionpool.HTTPSConnectionPool object at 0x0000025A9F7D42B0>              │ │
│ │                timeout = Timeout(connect=None, read=None, total=None)                                           │ │
│ │            timeout_obj = Timeout(connect=None, read=None, total=None)                                           │ │
│ │                    url = '/static/2023/2023-05-07_Miami_Grand_Prix/2023-05-06_Practice_3/Position.z.jsonSt'+4   │ │
│ └─────────────────────────────────────────────────────────────────────────────────────────────────────────────────┘ │
│                                                                                                                     │
│ C:\Users\Peter\AppData\Local\Programs\Python\Python313\Lib\site-packages\urllib3\connectionpool.py:1095 in          │
│ _validate_conn                                                                                                      │
│                                                                                                                     │
│   1092 │   │                                                                                                        │
│   1093 │   │   # Force connect early to allow us to validate the connection.                                        │
│   1094 │   │   if conn.is_closed:                                                                                   │
│ > 1095 │   │   │   conn.connect()                                                                                   │
│   1096 │   │                                                                                                        │
│   1097 │   │   # TODO revise this, see https://github.com/urllib3/urllib3/issues/2791                               │
│   1098 │   │   if not conn.is_verified and not conn.proxy_is_verified:                                              │
│                                                                                                                     │
│ ┌───────────────────────────────────── locals ─────────────────────────────────────┐                                │
│ │ conn = <urllib3.connection.HTTPSConnection object at 0x00000259CF4A8690>         │                                │
│ │ self = <urllib3.connectionpool.HTTPSConnectionPool object at 0x0000025A9F7D42B0> │                                │
│ └──────────────────────────────────────────────────────────────────────────────────┘                                │
│                                                                                                                     │
│ C:\Users\Peter\AppData\Local\Programs\Python\Python313\Lib\site-packages\urllib3\connection.py:693 in connect       │
│                                                                                                                     │
│    690 │   │                                                                                                        │
│    691 │   │   try:                                                                                                 │
│    692 │   │   │   sock: socket.socket | ssl.SSLSocket                                                              │
│ >  693 │   │   │   self.sock = sock = self._new_conn()                                                              │
│    694 │   │   │   server_hostname: str = self.host                                                                 │
│    695 │   │   │   tls_in_tls = False                                                                               │
│    696                                                                                                              │
│                                                                                                                     │
│ ┌───────────────────────────────────────── locals ──────────────────────────────────────────┐                       │
│ │      probe_http2_host = 'livetiming.formula1.com'                                         │                       │
│ │      probe_http2_port = 443                                                               │                       │
│ │                  self = <urllib3.connection.HTTPSConnection object at 0x00000259CF4A8690> │                       │
│ │ target_supports_http2 = False                                                             │                       │
│ └───────────────────────────────────────────────────────────────────────────────────────────┘                       │
│                                                                                                                     │
│ C:\Users\Peter\AppData\Local\Programs\Python\Python313\Lib\site-packages\urllib3\connection.py:206 in _new_conn     │
│                                                                                                                     │
│    203 │   │   │   │   socket_options=self.socket_options,                                                          │
│    204 │   │   │   )                                                                                                │
│    205 │   │   except socket.gaierror as e:                                                                         │
│ >  206 │   │   │   raise NameResolutionError(self.host, self, e) from e                                             │
│    207 │   │   except SocketTimeout as e:                                                                           │
│    208 │   │   │   raise ConnectTimeoutError(                                                                       │
│    209 │   │   │   │   self,                                                                                        │
│                                                                                                                     │
│ ┌───────────────────────────────── locals ─────────────────────────────────┐                                        │
│ │ self = <urllib3.connection.HTTPSConnection object at 0x00000259CF4A8690> │                                        │
│ └──────────────────────────────────────────────────────────────────────────┘                                        │
└─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┘
NameResolutionError: <urllib3.connection.HTTPSConnection object at 0x00000259CF4A8690>: Failed to resolve
'livetiming.formula1.com' ([Errno 11001] getaddrinfo failed)

The above exception was the direct cause of the following exception:

┌───────────────────────────────────────── Traceback (most recent call last) ─────────────────────────────────────────┐
│ C:\Users\Peter\AppData\Local\Programs\Python\Python313\Lib\site-packages\requests\adapters.py:667 in send           │
│                                                                                                                     │
│   664 │   │   │   timeout = TimeoutSauce(connect=timeout, read=timeout)                                             │
│   665 │   │                                                                                                         │
│   666 │   │   try:                                                                                                  │
│ > 667 │   │   │   resp = conn.urlopen(                                                                              │
│   668 │   │   │   │   method=request.method,                                                                        │
│   669 │   │   │   │   url=url,                                                                                      │
│   670 │   │   │   │   body=request.body,                                                                            │
│                                                                                                                     │
│ ┌──────────────────────────────────────────── locals ────────────────────────────────────────────┐                  │
│ │    cert = None                                                                                 │                  │
│ │ chunked = False                                                                                │                  │
│ │    conn = <urllib3.connectionpool.HTTPSConnectionPool object at 0x0000025A9F7D42B0>            │                  │
│ │ proxies = OrderedDict()                                                                        │                  │
│ │ request = <PreparedRequest [GET]>                                                              │                  │
│ │    self = <requests.adapters.HTTPAdapter object at 0x0000025A0405B950>                         │                  │
│ │  stream = False                                                                                │                  │
│ │ timeout = Timeout(connect=None, read=None, total=None)                                         │                  │
│ │     url = '/static/2023/2023-05-07_Miami_Grand_Prix/2023-05-06_Practice_3/Position.z.jsonSt'+4 │                  │
│ │  verify = True                                                                                 │                  │
│ └────────────────────────────────────────────────────────────────────────────────────────────────┘                  │
│                                                                                                                     │
│ C:\Users\Peter\AppData\Local\Programs\Python\Python313\Lib\site-packages\urllib3\connectionpool.py:843 in urlopen   │
│                                                                                                                     │
│    840 │   │   │   elif isinstance(new_e, (OSError, HTTPException)):                                                │
│    841 │   │   │   │   new_e = ProtocolError("Connection aborted.", new_e)                                          │
│    842 │   │   │                                                                                                    │
│ >  843 │   │   │   retries = retries.increment(                                                                     │
│    844 │   │   │   │   method, url, error=new_e, _pool=self, _stacktrace=sys.exc_info()[2]                          │
│    845 │   │   │   )                                                                                                │
│    846 │   │   │   retries.sleep()                                                                                  │
│                                                                                                                     │
│ ┌──────────────────────────────────────────────────── locals ─────────────────────────────────────────────────────┐ │
│ │     assert_same_host = False                                                                                    │ │
│ │                 body = None                                                                                     │ │
│ │             body_pos = None                                                                                     │ │
│ │              chunked = False                                                                                    │ │
│ │           clean_exit = False                                                                                    │ │
│ │                 conn = None                                                                                     │ │
│ │       decode_content = False                                                                                    │ │
│ │   destination_scheme = None                                                                                     │ │
│ │                  err = None                                                                                     │ │
│ │              headers = {'User-Agent': 'python-requests/2.32.3', 'Accept-Encoding': 'gzip, deflate', 'Accept':   │ │
│ │                        '*/*', 'Connection': 'keep-alive'}                                                       │ │
│ │ http_tunnel_required = False                                                                                    │ │
│ │               method = 'GET'                                                                                    │ │
│ │                new_e = NameResolutionError("<urllib3.connection.HTTPSConnection object at 0x00000259CF4A8690>:  │ │
│ │                        Failed to resolve 'livetiming.formula1.com' ([Errno 11001] getaddrinfo failed)")         │ │
│ │           parsed_url = Url(                                                                                     │ │
│ │                        │   scheme=None,                                                                         │ │
│ │                        │   auth=None,                                                                           │ │
│ │                        │   host=None,                                                                           │ │
│ │                        │   port=None,                                                                           │ │
│ │                        │                                                                                        │ │
│ │                        path='/static/2023/2023-05-07_Miami_Grand_Prix/2023-05-06_Practice_3/Position.z.jsonSt'… │ │
│ │                        │   query=None,                                                                          │ │
│ │                        │   fragment=None                                                                        │ │
│ │                        )                                                                                        │ │
│ │         pool_timeout = None                                                                                     │ │
│ │      preload_content = False                                                                                    │ │
│ │             redirect = False                                                                                    │ │
│ │         release_conn = False                                                                                    │ │
│ │    release_this_conn = True                                                                                     │ │
│ │        response_conn = <urllib3.connection.HTTPSConnection object at 0x00000259CF4A8690>                        │ │
│ │          response_kw = {}                                                                                       │ │
│ │              retries = Retry(total=0, connect=None, read=False, redirect=None, status=None)                     │ │
│ │                 self = <urllib3.connectionpool.HTTPSConnectionPool object at 0x0000025A9F7D42B0>                │ │
│ │              timeout = Timeout(connect=None, read=None, total=None)                                             │ │
│ │          timeout_obj = Timeout(connect=None, read=None, total=None)                                             │ │
│ │                  url = '/static/2023/2023-05-07_Miami_Grand_Prix/2023-05-06_Practice_3/Position.z.jsonSt'+4     │ │
│ └─────────────────────────────────────────────────────────────────────────────────────────────────────────────────┘ │
│                                                                                                                     │
│ C:\Users\Peter\AppData\Local\Programs\Python\Python313\Lib\site-packages\urllib3\util\retry.py:519 in increment     │
│                                                                                                                     │
│   516 │   │                                                                                                         │
│   517 │   │   if new_retry.is_exhausted():                                                                          │
│   518 │   │   │   reason = error or ResponseError(cause)                                                            │
│ > 519 │   │   │   raise MaxRetryError(_pool, url, reason) from reason  # type: ignore[arg-type                      │
│   520 │   │                                                                                                         │
│   521 │   │   log.debug("Incremented Retry for (url='%s'): %r", url, new_retry)                                     │
│   522                                                                                                               │
│                                                                                                                     │
│ ┌──────────────────────────────────────────────────── locals ─────────────────────────────────────────────────────┐ │
│ │             _pool = <urllib3.connectionpool.HTTPSConnectionPool object at 0x0000025A9F7D42B0>                   │ │
│ │       _stacktrace = <traceback object at 0x0000025A035FEDC0>                                                    │ │
│ │             cause = 'unknown'                                                                                   │ │
│ │           connect = None                                                                                        │ │
│ │             error = NameResolutionError("<urllib3.connection.HTTPSConnection object at 0x00000259CF4A8690>:     │ │
│ │                     Failed to resolve 'livetiming.formula1.com' ([Errno 11001] getaddrinfo failed)")            │ │
│ │           history = (                                                                                           │ │
│ │                     │   RequestHistory(                                                                         │ │
│ │                     │   │   method='GET',                                                                       │ │
│ │                     │   │                                                                                       │ │
│ │                     url='/static/2023/2023-05-07_Miami_Grand_Prix/2023-05-06_Practice_3/Position.z.jsonSt'+4,   │ │
│ │                     │   │   error=NameResolutionError("<urllib3.connection.HTTPSConnection object at            │ │
│ │                     0x00000259CF4A8690>: Failed to resolve 'livetiming.formula1.com' ([Errno 11001] getaddrinfo │ │
│ │                     failed)"),                                                                                  │ │
│ │                     │   │   status=None,                                                                        │ │
│ │                     │   │   redirect_location=None                                                              │ │
│ │                     │   ),                                                                                      │ │
│ │                     )                                                                                           │ │
│ │            method = 'GET'                                                                                       │ │
│ │         new_retry = Retry(total=-1, connect=None, read=False, redirect=None, status=None)                       │ │
│ │             other = None                                                                                        │ │
│ │              read = False                                                                                       │ │
│ │            reason = NameResolutionError("<urllib3.connection.HTTPSConnection object at 0x00000259CF4A8690>:     │ │
│ │                     Failed to resolve 'livetiming.formula1.com' ([Errno 11001] getaddrinfo failed)")            │ │
│ │          redirect = None                                                                                        │ │
│ │ redirect_location = None                                                                                        │ │
│ │          response = None                                                                                        │ │
│ │              self = Retry(total=0, connect=None, read=False, redirect=None, status=None)                        │ │
│ │            status = None                                                                                        │ │
│ │      status_count = None                                                                                        │ │
│ │             total = -1                                                                                          │ │
│ │               url = '/static/2023/2023-05-07_Miami_Grand_Prix/2023-05-06_Practice_3/Position.z.jsonSt'+4        │ │
│ └─────────────────────────────────────────────────────────────────────────────────────────────────────────────────┘ │
└─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┘
MaxRetryError: HTTPSConnectionPool(host='livetiming.formula1.com', port=443): Max retries exceeded with url:
/static/2023/2023-05-07_Miami_Grand_Prix/2023-05-06_Practice_3/Position.z.jsonStream (Caused by
NameResolutionError("<urllib3.connection.HTTPSConnection object at 0x00000259CF4A8690>: Failed to resolve
'livetiming.formula1.com' ([Errno 11001] getaddrinfo failed)"))

During handling of the above exception, another exception occurred:

┌───────────────────────────────────────── Traceback (most recent call last) ─────────────────────────────────────────┐
│ C:\Users\Peter\Downloads\opensource\openf1\src\openf1\services\ingestor_livetiming\historical\main.py:394 in        │
│ ingest_season                                                                                                       │
│                                                                                                                     │
│   391 │   for meeting_key in meeting_keys:                                                                          │
│   392 │   │   if verbose:                                                                                           │
│   393 │   │   │   logger.info(f"Ingesting meeting {meeting_key}")                                                   │
│ > 394 │   │   ingest_meeting(year=year, meeting_key=meeting_key, verbose=False)                                     │
│   395                                                                                                               │
│   396                                                                                                               │
│   397 if __name__ == "__main__":                                                                                    │
│                                                                                                                     │
│ ┌─────────────────────────────────────── locals ───────────────────────────────────────┐                            │
│ │  meeting_key = 1208                                                                  │                            │
│ │ meeting_keys = [1140, 1141, 1142, 1143, 1207, 1208, 1210, 1211, 1212, 1213, ... +13] │                            │
│ │      verbose = True                                                                  │                            │
│ │         year = 2023                                                                  │                            │
│ └──────────────────────────────────────────────────────────────────────────────────────┘                            │
│                                                                                                                     │
│ C:\Users\Peter\Downloads\opensource\openf1\src\openf1\services\ingestor_livetiming\historical\main.py:380 in        │
│ ingest_meeting                                                                                                      │
│                                                                                                                     │
│   377 │   for session_key in session_keys:                                                                          │
│   378 │   │   if verbose:                                                                                           │
│   379 │   │   │   logger.info(f"Ingesting session {session_key}")                                                   │
│ > 380 │   │   ingest_session(                                                                                       │
│   381 │   │   │   year=year, meeting_key=meeting_key, session_key=session_key, verbose=False                        │
│   382 │   │   )                                                                                                     │
│   383                                                                                                               │
│                                                                                                                     │
│ ┌─────────────────── locals ────────────────────┐                                                                   │
│ │  meeting_key = 1208                           │                                                                   │
│ │  session_key = 9073                           │                                                                   │
│ │ session_keys = [9071, 9072, 9073, 9074, 9078] │                                                                   │
│ │      verbose = False                          │                                                                   │
│ │         year = 2023                           │                                                                   │
│ └───────────────────────────────────────────────┘                                                                   │
│                                                                                                                     │
│ C:\Users\Peter\Downloads\opensource\openf1\src\openf1\services\ingestor_livetiming\historical\main.py:362 in        │
│ ingest_session                                                                                                      │
│                                                                                                                     │
│   359 │   │   │   f"Ingesting {len(collection_names)} collections: {collection_names}"                              │
│   360 │   │   )                                                                                                     │
│   361 │                                                                                                             │
│ > 362 │   ingest_collections(                                                                                       │
│   363 │   │   year=year,                                                                                            │
│   364 │   │   meeting_key=meeting_key,                                                                              │
│   365 │   │   session_key=session_key,                                                                              │
│                                                                                                                     │
│ ┌──────────────────────────────────────────────────── locals ─────────────────────────────────────────────────────┐ │
│ │ collection_names = [                                                                                            │ │
│ │                    │   'car_data',                                                                              │ │
│ │                    │   'drivers',                                                                               │ │
│ │                    │   'intervals',                                                                             │ │
│ │                    │   'laps',                                                                                  │ │
│ │                    │   'location',                                                                              │ │
│ │                    │   'meetings',                                                                              │ │
│ │                    │   'pit',                                                                                   │ │
│ │                    │   'position',                                                                              │ │
│ │                    │   'race_control',                                                                          │ │
│ │                    │   'sessions',                                                                              │ │
│ │                    │   ... +3                                                                                   │ │
│ │                    ]                                                                                            │ │
│ │      collections = [                                                                                            │ │
│ │                    │   CarDataCollection(meeting_key=1208, session_key=9073, name=None, source_topics=None),    │ │
│ │                    │   DriversCollection(meeting_key=1208, session_key=9073, name=None, source_topics=None),    │ │
│ │                    │   IntervalsCollection(                                                                     │ │
│ │                    │   │   meeting_key=1208,                                                                    │ │
│ │                    │   │   session_key=9073,                                                                    │ │
│ │                    │   │   name=None,                                                                           │ │
│ │                    │   │   source_topics=None                                                                   │ │
│ │                    │   ),                                                                                       │ │
│ │                    │   LapsCollection(meeting_key=1208, session_key=9073, name=None, source_topics=None),       │ │
│ │                    │   LocationCollection(meeting_key=1208, session_key=9073, name=None, source_topics=None),   │ │
│ │                    │   MeetingsCollection(meeting_key=1208, session_key=9073, name=None, source_topics=None),   │ │
│ │                    │   PitCollection(meeting_key=1208, session_key=9073, name=None, source_topics=None),        │ │
│ │                    │   PositionCollection(meeting_key=1208, session_key=9073, name=None, source_topics=None),   │ │
│ │                    │   RaceControlCollection(                                                                   │ │
│ │                    │   │   meeting_key=1208,                                                                    │ │
│ │                    │   │   session_key=9073,                                                                    │ │
│ │                    │   │   name=None,                                                                           │ │
│ │                    │   │   source_topics=None                                                                   │ │
│ │                    │   ),                                                                                       │ │
│ │                    │   SessionsCollection(meeting_key=1208, session_key=9073, name=None, source_topics=None),   │ │
│ │                    │   ... +3                                                                                   │ │
│ │                    ]                                                                                            │ │
│ │      meeting_key = 1208                                                                                         │ │
│ │      session_key = 9073                                                                                         │ │
│ │          verbose = False                                                                                        │ │
│ │             year = 2023                                                                                         │ │
│ └─────────────────────────────────────────────────────────────────────────────────────────────────────────────────┘ │
│                                                                                                                     │
│ C:\Users\Peter\Downloads\opensource\openf1\src\openf1\services\ingestor_livetiming\historical\main.py:337 in        │
│ ingest_collections                                                                                                  │
│                                                                                                                     │
│   334 │   collection_names: list[str],                                                                              │
│   335 │   verbose: bool = True,                                                                                     │
│   336 ):                                                                                                            │
│ > 337 │   docs_by_collection = _get_processed_documents(                                                            │
│   338 │   │   year=year,                                                                                            │
│   339 │   │   meeting_key=meeting_key,                                                                              │
│   340 │   │   session_key=session_key,                                                                              │
│                                                                                                                     │
│ ┌──────────────── locals ────────────────┐                                                                          │
│ │ collection_names = [                   │                                                                          │
│ │                    │   'car_data',     │                                                                          │
│ │                    │   'drivers',      │                                                                          │
│ │                    │   'intervals',    │                                                                          │
│ │                    │   'laps',         │                                                                          │
│ │                    │   'location',     │                                                                          │
│ │                    │   'meetings',     │                                                                          │
│ │                    │   'pit',          │                                                                          │
│ │                    │   'position',     │                                                                          │
│ │                    │   'race_control', │                                                                          │
│ │                    │   'sessions',     │                                                                          │
│ │                    │   ... +3          │                                                                          │
│ │                    ]                   │                                                                          │
│ │      meeting_key = 1208                │                                                                          │
│ │      session_key = 9073                │                                                                          │
│ │          verbose = False               │                                                                          │
│ │             year = 2023                │                                                                          │
│ └────────────────────────────────────────┘                                                                          │
│                                                                                                                     │
│ C:\Users\Peter\Downloads\opensource\openf1\src\openf1\services\ingestor_livetiming\historical\main.py:270 in        │
│ _get_processed_documents                                                                                            │
│                                                                                                                     │
│   267 │   if verbose:                                                                                               │
│   268 │   │   logger.info(f"Session URL: {session_url}")                                                            │
│   269 │                                                                                                             │
│ > 270 │   t0 = _get_t0(session_url)                                                                                 │
│   271 │   if verbose:                                                                                               │
│   272 │   │   logger.info(f"t0: {t0}")                                                                              │
│   273                                                                                                               │
│                                                                                                                     │
│ ┌───────────────────────────────────────────────── locals ─────────────────────────────────────────────────┐        │
│ │ collection_names = [                                                                                     │        │
│ │                    │   'car_data',                                                                       │        │
│ │                    │   'drivers',                                                                        │        │
│ │                    │   'intervals',                                                                      │        │
│ │                    │   'laps',                                                                           │        │
│ │                    │   'location',                                                                       │        │
│ │                    │   'meetings',                                                                       │        │
│ │                    │   'pit',                                                                            │        │
│ │                    │   'position',                                                                       │        │
│ │                    │   'race_control',                                                                   │        │
│ │                    │   'sessions',                                                                       │        │
│ │                    │   ... +3                                                                            │        │
│ │                    ]                                                                                     │        │
│ │      meeting_key = 1208                                                                                  │        │
│ │      session_key = 9073                                                                                  │        │
│ │      session_url = 'https://livetiming.formula1.com/static/2023/2023-05-07_Miami_Grand_Prix/2023-05-'+13 │        │
│ │          verbose = False                                                                                 │        │
│ │             year = 2023                                                                                  │        │
│ └──────────────────────────────────────────────────────────────────────────────────────────────────────────┘        │
│                                                                                                                     │
│ C:\Users\Peter\Downloads\opensource\openf1\src\openf1\services\ingestor_livetiming\historical\main.py:170 in        │
│ _get_t0                                                                                                             │
│                                                                                                                     │
│   167 │   t_ref = datetime(1970, 1, 1)                                                                              │
│   168 │   t0_candidates = []                                                                                        │
│   169 │                                                                                                             │
│ > 170 │   position_content = _get_topic_content(session_url=session_url, topic="Position.z")                        │
│   171 │   position_messages = _parse_and_decode_topic_content(                                                      │
│   172 │   │   topic="Position.z",                                                                                   │
│   173 │   │   topic_raw_content=position_content,                                                                   │
│                                                                                                                     │
│ ┌─────────────────────────────────────────────── locals ────────────────────────────────────────────────┐           │
│ │   session_url = 'https://livetiming.formula1.com/static/2023/2023-05-07_Miami_Grand_Prix/2023-05-'+13 │           │
│ │ t0_candidates = []                                                                                    │           │
│ │         t_ref = datetime.datetime(1970, 1, 1, 0, 0)                                                   │           │
│ └───────────────────────────────────────────────────────────────────────────────────────────────────────┘           │
│                                                                                                                     │
│ C:\Users\Peter\Downloads\opensource\openf1\src\openf1\services\ingestor_livetiming\historical\main.py:100 in        │
│ _get_topic_content                                                                                                  │
│                                                                                                                     │
│    97 def _get_topic_content(session_url: str, topic: str) -> list[str]:                                            │
│    98 │   topic_filename = f"{topic}.jsonStream"                                                                    │
│    99 │   url_topic = join_url(session_url, topic_filename)                                                         │
│ > 100 │   topic_content = requests.get(url_topic).text.split("\r\n")                                                │
│   101 │   return topic_content                                                                                      │
│   102                                                                                                               │
│   103                                                                                                               │
│                                                                                                                     │
│ ┌──────────────────────────────────────────────── locals ────────────────────────────────────────────────┐          │
│ │    session_url = 'https://livetiming.formula1.com/static/2023/2023-05-07_Miami_Grand_Prix/2023-05-'+13 │          │
│ │          topic = 'Position.z'                                                                          │          │
│ │ topic_filename = 'Position.z.jsonStream'                                                               │          │
│ │      url_topic = 'https://livetiming.formula1.com/static/2023/2023-05-07_Miami_Grand_Prix/2023-05-'+35 │          │
│ └────────────────────────────────────────────────────────────────────────────────────────────────────────┘          │
│                                                                                                                     │
│ C:\Users\Peter\AppData\Local\Programs\Python\Python313\Lib\site-packages\requests\api.py:73 in get                  │
│                                                                                                                     │
│    70 │   :rtype: requests.Response                                                                                 │
│    71 │   """                                                                                                       │
│    72 │                                                                                                             │
│ >  73 │   return request("get", url, params=params, **kwargs)                                                       │
│    74                                                                                                               │
│    75                                                                                                               │
│    76 def options(url, **kwargs):                                                                                   │
│                                                                                                                     │
│ ┌──────────────────────────────────────────── locals ────────────────────────────────────────────┐                  │
│ │ kwargs = {}                                                                                    │                  │
│ │ params = None                                                                                  │                  │
│ │    url = 'https://livetiming.formula1.com/static/2023/2023-05-07_Miami_Grand_Prix/2023-05-'+35 │                  │
│ └────────────────────────────────────────────────────────────────────────────────────────────────┘                  │
│                                                                                                                     │
│ C:\Users\Peter\AppData\Local\Programs\Python\Python313\Lib\site-packages\requests\api.py:59 in request              │
│                                                                                                                     │
│    56 │   # avoid leaving sockets open which can trigger a ResourceWarning in some                                  │
│    57 │   # cases, and look like a memory leak in others.                                                           │
│    58 │   with sessions.Session() as session:                                                                       │
│ >  59 │   │   return session.request(method=method, url=url, **kwargs)                                              │
│    60                                                                                                               │
│    61                                                                                                               │
│    62 def get(url, params=None, **kwargs):                                                                          │
│                                                                                                                     │
│ ┌──────────────────────────────────────────── locals ─────────────────────────────────────────────┐                 │
│ │  kwargs = {'params': None}                                                                      │                 │
│ │  method = 'get'                                                                                 │                 │
│ │ session = <requests.sessions.Session object at 0x0000025A6A2AF960>                              │                 │
│ │     url = 'https://livetiming.formula1.com/static/2023/2023-05-07_Miami_Grand_Prix/2023-05-'+35 │                 │
│ └─────────────────────────────────────────────────────────────────────────────────────────────────┘                 │
│                                                                                                                     │
│ C:\Users\Peter\AppData\Local\Programs\Python\Python313\Lib\site-packages\requests\sessions.py:589 in request        │
│                                                                                                                     │
│   586 │   │   │   "allow_redirects": allow_redirects,                                                               │
│   587 │   │   }                                                                                                     │
│   588 │   │   send_kwargs.update(settings)                                                                          │
│ > 589 │   │   resp = self.send(prep, **send_kwargs)                                                                 │
│   590 │   │                                                                                                         │
│   591 │   │   return resp                                                                                           │
│   592                                                                                                               │
│                                                                                                                     │
│ ┌──────────────────────────────────────────────── locals ─────────────────────────────────────────────────┐         │
│ │ allow_redirects = True                                                                                  │         │
│ │            auth = None                                                                                  │         │
│ │            cert = None                                                                                  │         │
│ │         cookies = None                                                                                  │         │
│ │            data = None                                                                                  │         │
│ │           files = None                                                                                  │         │
│ │         headers = None                                                                                  │         │
│ │           hooks = None                                                                                  │         │
│ │            json = None                                                                                  │         │
│ │          method = 'get'                                                                                 │         │
│ │          params = None                                                                                  │         │
│ │            prep = <PreparedRequest [GET]>                                                               │         │
│ │         proxies = {}                                                                                    │         │
│ │             req = <Request [GET]>                                                                       │         │
│ │            self = <requests.sessions.Session object at 0x0000025A6A2AF960>                              │         │
│ │     send_kwargs = {                                                                                     │         │
│ │                   │   'timeout': None,                                                                  │         │
│ │                   │   'allow_redirects': True,                                                          │         │
│ │                   │   'proxies': OrderedDict(),                                                         │         │
│ │                   │   'stream': False,                                                                  │         │
│ │                   │   'verify': True,                                                                   │         │
│ │                   │   'cert': None                                                                      │         │
│ │                   }                                                                                     │         │
│ │        settings = {'proxies': OrderedDict(), 'stream': False, 'verify': True, 'cert': None}             │         │
│ │          stream = None                                                                                  │         │
│ │         timeout = None                                                                                  │         │
│ │             url = 'https://livetiming.formula1.com/static/2023/2023-05-07_Miami_Grand_Prix/2023-05-'+35 │         │
│ │          verify = None                                                                                  │         │
│ └─────────────────────────────────────────────────────────────────────────────────────────────────────────┘         │
│                                                                                                                     │
│ C:\Users\Peter\AppData\Local\Programs\Python\Python313\Lib\site-packages\requests\sessions.py:703 in send           │
│                                                                                                                     │
│   700 │   │   start = preferred_clock()                                                                             │
│   701 │   │                                                                                                         │
│   702 │   │   # Send the request                                                                                    │
│ > 703 │   │   r = adapter.send(request, **kwargs)                                                                   │
│   704 │   │                                                                                                         │
│   705 │   │   # Total elapsed time of the request (approximately)                                                   │
│   706 │   │   elapsed = preferred_clock() - start                                                                   │
│                                                                                                                     │
│ ┌─────────────────────────────────────────────────── locals ───────────────────────────────────────────────────┐    │
│ │         adapter = <requests.adapters.HTTPAdapter object at 0x0000025A0405B950>                               │    │
│ │ allow_redirects = True                                                                                       │    │
│ │           hooks = {'response': []}                                                                           │    │
│ │          kwargs = {'timeout': None, 'proxies': OrderedDict(), 'stream': False, 'verify': True, 'cert': None} │    │
│ │         request = <PreparedRequest [GET]>                                                                    │    │
│ │            self = <requests.sessions.Session object at 0x0000025A6A2AF960>                                   │    │
│ │           start = 5179.7839938                                                                               │    │
│ │          stream = False                                                                                      │    │
│ └──────────────────────────────────────────────────────────────────────────────────────────────────────────────┘    │
│                                                                                                                     │
│ C:\Users\Peter\AppData\Local\Programs\Python\Python313\Lib\site-packages\requests\adapters.py:700 in send           │
│                                                                                                                     │
│   697 │   │   │   │   # This branch is for urllib3 v1.22 and later.                                                 │
│   698 │   │   │   │   raise SSLError(e, request=request)                                                            │
│   699 │   │   │                                                                                                     │
│ > 700 │   │   │   raise ConnectionError(e, request=request)                                                         │
│   701 │   │                                                                                                         │
│   702 │   │   except ClosedPoolError as e:                                                                          │
│   703 │   │   │   raise ConnectionError(e, request=request)                                                         │
│                                                                                                                     │
│ ┌──────────────────────────────────────────── locals ────────────────────────────────────────────┐                  │
│ │    cert = None                                                                                 │                  │
│ │ chunked = False                                                                                │                  │
│ │    conn = <urllib3.connectionpool.HTTPSConnectionPool object at 0x0000025A9F7D42B0>            │                  │
│ │ proxies = OrderedDict()                                                                        │                  │
│ │ request = <PreparedRequest [GET]>                                                              │                  │
│ │    self = <requests.adapters.HTTPAdapter object at 0x0000025A0405B950>                         │                  │
│ │  stream = False                                                                                │                  │
│ │ timeout = Timeout(connect=None, read=None, total=None)                                         │                  │
│ │     url = '/static/2023/2023-05-07_Miami_Grand_Prix/2023-05-06_Practice_3/Position.z.jsonSt'+4 │                  │
│ │  verify = True                                                                                 │                  │
│ └────────────────────────────────────────────────────────────────────────────────────────────────┘                  │
└─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┘
ConnectionError: HTTPSConnectionPool(host='livetiming.formula1.com', port=443): Max retries exceeded with url:
/static/2023/2023-05-07_Miami_Grand_Prix/2023-05-06_Practice_3/Position.z.jsonStream (Caused by
NameResolutionError("<urllib3.connection.HTTPSConnection object at 0x00000259CF4A8690>: Failed to resolve
'livetiming.formula1.com' ([Errno 11001] getaddrinfo failed)"))

[br-g]

Hi Peter,

Thank you for your interest in contributing to the project! It’s great to see you diving in and exploring the code.

The OpenF1 code is still in its alpha stage, so encountering errors at this point isn’t unexpected. If you’re able to help troubleshoot or resolve any of these issues, your contributions would be incredibly valuable and much appreciated!