mikf / gallery-dl

Command-line program to download image galleries and collections from several image hosting sites
GNU General Public License v2.0
11.35k stars 925 forks source link

Max retries exceeded with url on Kemono.su and Coomer.su #5843

Closed overattackwatch closed 2 months ago

overattackwatch commented 2 months ago

[downloader.http][warning] HTTPSConnectionPool(host='c2.kemono.su', port=443): Max retries exceeded with url: /data/bc/2a/bc2a9dc2f1d8159187abda9b326ceeaae9d48012124bef9603c9d1569c3fe6f7.png (Caused by SSLError(SSLError(1, '[SSL: WRONG_VERSION_NUMBER] wrong version number (_ssl.c:1000)'))) (1/5)

Hrxn commented 2 months ago

My money is on network issue etc. Not a gallery-dl issue.

overattackwatch commented 2 months ago

My money is on network issue etc. Not a gallery-dl issue.

do you have an idea on what I should do?

mikf commented 2 months ago

You could try looking through old issues with the same error, either in this repo or on GitHub in general. All three issues here appear to be proxy server related. https://github.com/mikf/gallery-dl/issues?q=is%3Aissue+WRONG_VERSION_NUMBER

overattackwatch commented 2 months ago

Tried a few of the fixes without success, I have not tried all of them, Kemono seems to be working fine again with Coomer still having the same issue

cheatreal321 commented 2 months ago

kemono.su and coomer.su servers are very poorly maintained - there's frequent reports of issues with certain servers loading content extremely slowly (around 50 KB/s) or not at all. This is definitely an issue on their end and not gallery-dl.

overattackwatch commented 2 months ago

kemono.su and coomer.su servers are very poorly maintained - there's frequent reports of issues with certain servers loading content extremely slowly (around 50 KB/s) or not at all. This is definitely an issue on their end and not gallery-dl.

its userbase seem to think coomer has been abandoned due to legal issues with a similar name or something so yeah

Hawker2 commented 1 month ago

Appears that n1.kemono.su is down; I can't load images there in a browser either. Leaving the content below in case anyone thinks they've run across this issue; might just be a down server.


FYI, I'm seeing the same things very frequently with kemono.su, and I have no proxies or VPNs in use. So nothing in the external network for me. I'm spacing out queries in what I believe is an acceptable pattern:

{
    "extractor":
    {
        "skip": true,
        "path-restrict": "windows",
        "path-strip": "windows",
        "sleep-request": [0.5, 1.5],
        "sleep-extractor": [0.5, 1.5],
        "sleep-429": 60,
        "user-agent": "Mozilla/5.0 (X11; Linux x86_64; rv:68.0) Gecko/20100101 Firefox/68.0",
        "base-directory": "kemono",

        "kemonoparty": {
            "metadata": true,
            "revisions": "unique",
            "directory": ["{service} {user} {username}", "{id} {title[:60]}"],
            "archive": "kemono/{service} {user} {username}/archive.db",
            "filename": "{id}_{num:>02}_{filename[:60]}.{extension}",
            "postprocessors": [
                {
                    "name": "metadata",
                    "event": "post",
                    "skip": true,
                    "filename": "{id} {title[:60]}.txt",

                    "#": "write text content and external URLs",
                    "mode": "custom",
                    "format": "{content}\n{embed[url]:?/\n/}",

                    "#": "only write file if there is an external link present",
                    "filter": "embed.get('url') or re.search(r'(?i)(gigafile|xgf|1drv|mediafire|mega|google|drive|anonfiles)', content)"
                }
            ]
        }
    },

    "output":
    {
        "skip": false
    }
}

Tried increasing the delay to up to 10 seconds; no change. I do notice that all of the failures are to host n1.kemono.su. Could be something misconfigured on it - but can't gallerydl detect this situation similarly to 429's?

[downloader.http][warning] HTTPSConnectionPool(host='n1.kemono.su', port=443): Max retries exceeded with url: /data/5d/d0/5dd0cd5dae877181acc6e5e8554af2ba1050e9d49592b5cf85bac22b98027846.jpg (Caused by ConnectTimeoutError(<urllib3.connection.HTTPSConnection object at 0x7fa306df6a90>, 'Connection to n1.kemono.su timed out. (connect timeout=30)')) (1/5)
[downloader.http][warning] HTTPSConnectionPool(host='n1.kemono.su', port=443): Max retries exceeded with url: /data/5d/d0/5dd0cd5dae877181acc6e5e8554af2ba1050e9d49592b5cf85bac22b98027846.jpg (Caused by ConnectTimeoutError(<urllib3.connection.HTTPSConnection object at 0x7fa306916890>, 'Connection to n1.kemono.su timed out. (connect timeout=30)')) (2/5)
[downloader.http][warning] HTTPSConnectionPool(host='n1.kemono.su', port=443): Max retries exceeded with url: /data/5d/d0/5dd0cd5dae877181acc6e5e8554af2ba1050e9d49592b5cf85bac22b98027846.jpg (Caused by ConnectTimeoutError(<urllib3.connection.HTTPSConnection object at 0x7fa3069250d0>, 'Connection to n1.kemono.su timed out. (connect timeout=30)')) (3/5)
[downloader.http][warning] HTTPSConnectionPool(host='n1.kemono.su', port=443): Max retries exceeded with url: /data/5d/d0/5dd0cd5dae877181acc6e5e8554af2ba1050e9d49592b5cf85bac22b98027846.jpg (Caused by ConnectTimeoutError(<urllib3.connection.HTTPSConnection object at 0x7fa306917350>, 'Connection to n1.kemono.su timed out. (connect timeout=30)')) (4/5)
[downloader.http][warning] HTTPSConnectionPool(host='n1.kemono.su', port=443): Max retries exceeded with url: /data/5d/d0/5dd0cd5dae877181acc6e5e8554af2ba1050e9d49592b5cf85bac22b98027846.jpg (Caused by ConnectTimeoutError(<urllib3.connection.HTTPSConnection object at 0x7fa306df0310>, 'Connection to n1.kemono.su timed out. (connect timeout=30)')) (5/5)