Code Monkey home page Code Monkey logo

Comments (8)

chriscrutch avatar chriscrutch commented on September 27, 2024 1

Waiting a little while and restarting the scan often "fixes" the issue.

Hasn't in this case. It has persisted for the last 36 hours and through re-starting the Docker container.

from romm.

gantoine avatar gantoine commented on September 27, 2024 1

Got a fix for this here anyways, so hopefully it doesn't happen next time you get rate limited! Will be in the next release. #882

urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='api.igdb.com', port=443): Max retries exceeded with url: /v4/platforms (Caused by NameResolutionError("<urllib3.connection.HTTPSConnection object at 0x7f647fe53fd0>: Failed to resolve 'api.igdb.com' ([Errno -3] Try again)"))

from romm.

gantoine avatar gantoine commented on September 27, 2024

Oh cool find! I'll have a look tonight and likely have a fix out before the next release.

from romm.

gantoine avatar gantoine commented on September 27, 2024

@chriscrutch can you post the containers logs right after a scan?

from romm.

chriscrutch avatar chriscrutch commented on September 27, 2024

@gantoine
Here you are:

[2024-05-22 12:51:09 -0400] [38] [INFO] None - "WebSocket /ws/socket.io/?EIO=4&transport=websocket" [accepted]

[2024-05-22 12:51:09 -0400] [38] [INFO] connection open

INFO:	  [RomM][2024-05-22 12:51:09] πŸ”Ž Scanning 

12:51:09 high: endpoints.sockets.scan.scan_platforms([], <ScanType.QUICK: 'quick'>, [], ['moby']) (8b63bd32-4464-41aa-9530-edd0cf2f2dba)

INFO:	  [RomM][2024-05-22 12:51:10] Found 74 platforms in file system 

INFO:	  [RomM][2024-05-22 12:51:10] Β· n64

CRITICAL: [RomM][2024-05-22 12:51:15] Connection error: can't connect to IGDB

Traceback (most recent call last):

  File "/backend/lib/python3.11/site-packages/urllib3/connection.py", line 198, in _new_conn

    sock = connection.create_connection(

           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

  File "/backend/lib/python3.11/site-packages/urllib3/util/connection.py", line 60, in create_connection

    for res in socket.getaddrinfo(host, port, family, socket.SOCK_STREAM):

               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

  File "/usr/lib/python3.11/socket.py", line 962, in getaddrinfo

    for res in _socket.getaddrinfo(host, port, family, type, proto, flags):

               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

socket.gaierror: [Errno -3] Try again

The above exception was the direct cause of the following exception:

Traceback (most recent call last):

  File "/backend/lib/python3.11/site-packages/urllib3/connectionpool.py", line 793, in urlopen

    response = self._make_request(

               ^^^^^^^^^^^^^^^^^^^

  File "/backend/lib/python3.11/site-packages/urllib3/connectionpool.py", line 491, in _make_request

    raise new_e

  File "/backend/lib/python3.11/site-packages/urllib3/connectionpool.py", line 467, in _make_request

    self._validate_conn(conn)

  File "/backend/lib/python3.11/site-packages/urllib3/connectionpool.py", line 1099, in _validate_conn

    conn.connect()

  File "/backend/lib/python3.11/site-packages/urllib3/connection.py", line 616, in connect

    self.sock = sock = self._new_conn()

                       ^^^^^^^^^^^^^^^^

  File "/backend/lib/python3.11/site-packages/urllib3/connection.py", line 205, in _new_conn

    raise NameResolutionError(self.host, self, e) from e

urllib3.exceptions.NameResolutionError: <urllib3.connection.HTTPSConnection object at 0x7f647fe53fd0>: Failed to resolve 'api.igdb.com' ([Errno -3] Try again)

The above exception was the direct cause of the following exception:

Traceback (most recent call last):

  File "/backend/lib/python3.11/site-packages/requests/adapters.py", line 486, in send

    resp = conn.urlopen(

           ^^^^^^^^^^^^^

  File "/backend/lib/python3.11/site-packages/urllib3/connectionpool.py", line 847, in urlopen

    retries = retries.increment(

              ^^^^^^^^^^^^^^^^^^

  File "/backend/lib/python3.11/site-packages/urllib3/util/retry.py", line 515, in increment

    raise MaxRetryError(_pool, url, reason) from reason  # type: ignore[arg-type]

    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='api.igdb.com', port=443): Max retries exceeded with url: /v4/platforms (Caused by NameResolutionError("<urllib3.connection.HTTPSConnection object at 0x7f647fe53fd0>: Failed to resolve 'api.igdb.com' ([Errno -3] Try again)"))

During handling of the above exception, another exception occurred:

Traceback (most recent call last):

  File "/backend/handler/metadata_handler/igdb_handler.py", line 161, in _request

    res = requests.post(

          ^^^^^^^^^^^^^^

  File "/backend/lib/python3.11/site-packages/requests/api.py", line 115, in post

    return request("post", url, data=data, json=json, **kwargs)

           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

  File "/backend/lib/python3.11/site-packages/requests/api.py", line 59, in request

    return session.request(method=method, url=url, **kwargs)

           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

  File "/backend/lib/python3.11/site-packages/requests/sessions.py", line 589, in request

    resp = self.send(prep, **send_kwargs)

           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

  File "/backend/lib/python3.11/site-packages/requests/sessions.py", line 703, in send

    r = adapter.send(request, **kwargs)

        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

  File "/backend/lib/python3.11/site-packages/requests/adapters.py", line 519, in send

    raise ConnectionError(e, request=request)

requests.exceptions.ConnectionError: HTTPSConnectionPool(host='api.igdb.com', port=443): Max retries exceeded with url: /v4/platforms (Caused by NameResolutionError("<urllib3.connection.HTTPSConnection object at 0x7f647fe53fd0>: Failed to resolve 'api.igdb.com' ([Errno -3] Try again)"))

ERROR:	  [RomM][2024-05-22 12:51:15] 503: Can't connect to IGDB, check your internet connection

12:51:15 high: Job OK (8b63bd32-4464-41aa-9530-edd0cf2f2dba)

12:51:15 Result is kept for 500 seconds

INFO:	  [nginx][2024-05-22 ]	100.114.136.83 - - "GET /ws/socket.io/?EIO=4&transport=websocket HTTP/1.1" 101 186 "-" "Mozilla/5.0 (X11; Linux x86_64; rv:126.0) Gecko/20100101 Firefox/126.0" rt=11.275 uct="0.000" uht="4.460" urt="11.276"

[2024-05-22 12:51:16 -0400] [38] [INFO] connection closed

from romm.

gantoine avatar gantoine commented on September 27, 2024

Caused by NameResolutionError("<urllib3.connection.HTTPSConnection object at 0x7f647fe53fd0>: Failed to resolve 'api.igdb.com' ([Errno -3] Try again)")

Seems it's dropping the connection to IGDB after some time and not able to recover. Waiting a little while and restarting the scan often "fixes" the issue.

from romm.

chriscrutch avatar chriscrutch commented on September 27, 2024

The issue has resolved now, I guess. After several days I was able to access IGDB again (API call limit reset, maybe?) and the scans work fine. Whatever was keeping me from accessing IGDB still shouldn't have caused an error when scanning without IGDB, however.

from romm.

chriscrutch avatar chriscrutch commented on September 27, 2024

Thank you!

from romm.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    πŸ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. πŸ“ŠπŸ“ˆπŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❀️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.