mikf / gallery-dl

Command-line program to download image galleries and collections from several image hosting sites
GNU General Public License v2.0
11.36k stars 925 forks source link

[kemonoparty] SSLError record layer failure #5986

Closed b331z3bub closed 2 weeks ago

b331z3bub commented 1 month ago

I think this might be a different type of error than the other SSLErrors that have been submitted, but I might be wrong. Gallery-dl is able to get metadata when the --no-download flag is used, but when the --no-download flag isn't used the files aren't not always able to be downloaded. On this artist's page, I was able to download about half of the files successfully from all 11 posts. Labels: nsfw

eg1) both metadata files downloaded

gallery-dl --write-metadata "https://kemono.su/gumroad/user/4280670680337/post/cForFp" --no-download
./gallery-dl/kemonoparty/gumroad/4280670680337/cForFp_april stuff_01_2021-4.rar
./gallery-dl/kemonoparty/gumroad/4280670680337/cForFp_april stuff_02_123124.jpg

eg2) 1/2 files downloaded

gallery-dl --write-metadata "https://kemono.su/gumroad/user/4280670680337/post/cForFp" --verbose   
[gallery-dl][debug] Version 1.27.2 - Git HEAD: 39d51a45e8
[gallery-dl][debug] Python 3.12.4 - macOS-13.2.1-arm64-arm-64bit
[gallery-dl][debug] requests 2.32.3 - urllib3 2.2.2
[gallery-dl][debug] Configuration Files ['/etc/gallery-dl.conf', '${HOME}/.config/gallery-dl/config.json']
[gallery-dl][debug] Starting DownloadJob for 'https://kemono.su/gumroad/user/4280670680337/post/cForFp'
[kemonoparty][debug] Using KemonopartyPostExtractor for 'https://kemono.su/gumroad/user/4280670680337/post/cForFp'
[urllib3.connectionpool][debug] Starting new HTTPS connection (1): kemono.su:443
[urllib3.connectionpool][debug] https://kemono.su:443 "GET /api/v1/gumroad/user/4280670680337/post/cForFp HTTP/11" 200 523
[kemonoparty][debug] Active postprocessor modules: [MetadataPP]
[urllib3.connectionpool][debug] https://kemono.su:443 "GET /data/ea/7c/ea7cbc49ad9dc54ea5800903b1f012b918853f7bf6efd4772151b9189af13850.bin HTTP/11" 302 138
[urllib3.connectionpool][debug] Starting new HTTPS connection (1): n2.kemono.su:443
[downloader.http][warning] HTTPSConnectionPool(host='n2.kemono.su', port=443): Max retries exceeded with url: /data/ea/7c/ea7cbc49ad9dc54ea5800903b1f012b918853f7bf6efd4772151b9189af13850.bin (Caused by SSLError(SSLError(1, '[SSL] record layer failure (_ssl.c:1000)'))) (1/5)
[urllib3.connectionpool][debug] https://kemono.su:443 "GET /data/ea/7c/ea7cbc49ad9dc54ea5800903b1f012b918853f7bf6efd4772151b9189af13850.bin HTTP/11" 302 138
[urllib3.connectionpool][debug] Starting new HTTPS connection (2): n2.kemono.su:443
[downloader.http][warning] HTTPSConnectionPool(host='n2.kemono.su', port=443): Max retries exceeded with url: /data/ea/7c/ea7cbc49ad9dc54ea5800903b1f012b918853f7bf6efd4772151b9189af13850.bin (Caused by SSLError(SSLError(1, '[SSL] record layer failure (_ssl.c:1000)'))) (2/5)
[urllib3.connectionpool][debug] https://kemono.su:443 "GET /data/ea/7c/ea7cbc49ad9dc54ea5800903b1f012b918853f7bf6efd4772151b9189af13850.bin HTTP/11" 302 138
[urllib3.connectionpool][debug] Starting new HTTPS connection (3): n2.kemono.su:443
[downloader.http][warning] HTTPSConnectionPool(host='n2.kemono.su', port=443): Max retries exceeded with url: /data/ea/7c/ea7cbc49ad9dc54ea5800903b1f012b918853f7bf6efd4772151b9189af13850.bin (Caused by SSLError(SSLError(1, '[SSL] record layer failure (_ssl.c:1000)'))) (3/5)
[urllib3.connectionpool][debug] https://kemono.su:443 "GET /data/ea/7c/ea7cbc49ad9dc54ea5800903b1f012b918853f7bf6efd4772151b9189af13850.bin HTTP/11" 302 138
[urllib3.connectionpool][debug] Starting new HTTPS connection (4): n2.kemono.su:443
[downloader.http][warning] HTTPSConnectionPool(host='n2.kemono.su', port=443): Max retries exceeded with url: /data/ea/7c/ea7cbc49ad9dc54ea5800903b1f012b918853f7bf6efd4772151b9189af13850.bin (Caused by SSLError(SSLError(1, '[SSL] record layer failure (_ssl.c:1000)'))) (4/5)
[urllib3.connectionpool][debug] https://kemono.su:443 "GET /data/ea/7c/ea7cbc49ad9dc54ea5800903b1f012b918853f7bf6efd4772151b9189af13850.bin HTTP/11" 302 138
[urllib3.connectionpool][debug] Starting new HTTPS connection (5): n2.kemono.su:443
[downloader.http][warning] HTTPSConnectionPool(host='n2.kemono.su', port=443): Max retries exceeded with url: /data/ea/7c/ea7cbc49ad9dc54ea5800903b1f012b918853f7bf6efd4772151b9189af13850.bin (Caused by SSLError(SSLError(1, '[SSL] record layer failure (_ssl.c:1000)'))) (5/5)
[download][error] Failed to download cForFp_april stuff_01_2021-4.rar
[urllib3.connectionpool][debug] https://kemono.su:443 "GET /data/c0/cd/c0cd1b645c13eae1ad77f302402e1c7645fe06e0644f8b38a257b704754876f4.jpg HTTP/11" 302 138
[urllib3.connectionpool][debug] Starting new HTTPS connection (1): n1.kemono.su:443
[urllib3.connectionpool][debug] https://n1.kemono.su:443 "GET /data/c0/cd/c0cd1b645c13eae1ad77f302402e1c7645fe06e0644f8b38a257b704754876f4.jpg HTTP/11" 200 1593391
./gallery-dl/kemonoparty/gumroad/4280670680337/cForFp_april stuff_02_123124.jpg
b331z3bub commented 1 month ago

This is almost redundant information, but I get the same error when the --no-check-certificate flag is used.

mikf commented 1 month ago

[SSL] record layer failure

Seems to be an issue with the n2.kemono.su server's SSL/TLS stack and/or your system's. (Works on my machine :tm:, by the way)

Search results give

which indicate that it might also be related to IPv4/IPv6, but I can't really help you with this.