mikf / gallery-dl

Command-line program to download image galleries and collections from several image hosting sites
GNU General Public License v2.0
12.01k stars 978 forks source link

[NSFW] Problem with zzup.com:gallery-dl #6506

Closed GotZan3 closed 5 days ago

GotZan3 commented 6 days ago

The second day since the download from zzup.com stopped working and gives an error: F:>gallery-dl.exe -v -o tls12=false --no-check-certificate --user-agent browser -C "zzup.com_cookies.txt" "https://zzup.com/content/NjQ5NTU1/100_of_stylerotica/MTE=/index.html" [gallery-dl][debug] Version 1.27.7 - Executable (stable/windows) [gallery-dl][debug] Python 3.8.10 - Windows-10-10.0.19045 [gallery-dl][debug] requests 2.32.3 - urllib3 2.2.3 [gallery-dl][debug] Configuration Files ['F:\gallery-dl.conf'] [gallery-dl][debug] Starting DownloadJob for 'https://zzup.com/content/NjQ5NTU1/100_of_stylerotica/MTE=/index.html' [zzup][debug] Using ZzupGalleryExtractor for 'https://zzup.com/content/NjQ5NTU1/100_of_stylerotica/MTE=/index.html' [zzup][debug] TLS 1.2 disabled. [zzup][debug] Loading cookies from 'zzup.com_cookies.txt' [urllib3.connectionpool][debug] Starting new HTTPS connection (1): zzup.com:443 urllib3\connectionpool.pyc:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'zzup.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings [urllib3.connectionpool][debug] https://zzup.com:443 "GET /content/NjQ5NTU1/100_of_stylerotica/MTE=/index.html HTTP/11" 200 76532 [urllib3.connectionpool][debug] https://zzup.com:443 "GET / HTTP/11" 200 76532

I use https://github.com/bol-van/zapret for work gallery-dl to access the specified address.

mikf commented 6 days ago

Works on my machine :tm:

$ gallery-dl https://zzup.com/content/NjQ5NTU1/100_of_stylerotica/MTE=/index.html
./zzup/100 of stylerotica/001.jpg
./zzup/100 of stylerotica/002.jpg
./zzup/100 of stylerotica/003.jpg
...

-o tls12=false --no-check-certificate --user-agent browser -C "zzup.com_cookies.txt"

Are these options really necessary for you to be able to access the site?

mikf commented 6 days ago
[urllib3.connectionpool][debug] [https://zzup.com:443](https://zzup.com/) "GET /content/NjQ5NTU1/100_of_stylerotica/MTE=/index.html HTTP/11" 200 76532

This URL's response does not have a specified length 76532 for me None. I suspect you aren't getting the actual page despite using /bol-van/zapret. Check the --write-pages output.

[urllib3.connectionpool][debug] https://zzup.com:443 "GET /content/NjQ5NTU1/100_of_stylerotica/MTE=/index.html HTTP/1.1" 200 None

edit: The full response should be ~17.8 kB.

GotZan3 commented 5 days ago

-o tls12=false --no-check-certificate --user-agent browser -C "zzup.com_cookies.txt"

Are these options really necessary for you to be able to access the site?

I didn't use these settings until a few months ago, but now it usually doesn't work without them.

Now I haven't changed anything, but everything works again, although it still displays the same message.

`F:>gallery-dl.exe -o tls12=false --no-check-certificate --user-agent browser -C "zzup.com_cookies.txt" "https://zzup.com/content/NjQ5NTU1/100_of_stylerotica/MTE=/index.html" urllib3\connectionpool.pyc:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'zzup.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings

Perhaps this is really related to /bol-van/zapret, since I only get access to zzup.com via Tor

mikf commented 5 days ago

although it still displays the same message.

The InsecureRequestWarning message is printed because of --no-check-certificate.

GotZan3 commented 5 days ago

I try now: F:>gallery-dl.exe https://zzup.com/content/NjQ5NTU1/100_of_stylerotica/MTE=/index.html urllib3\connectionpool.pyc:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'zzup.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings .\gallery-dl\zzup\100 of stylerotica\001.jpg .\gallery-dl\zzup\100 of stylerotica\002.jpg

It works but still same message

mikf commented 5 days ago

I'd guess there is a "verify": false setting somewhere in your config file, then.