search

mikf / gallery-dl

Command-line program to download image galleries and collections from several image hosting sites
GNU General Public License v2.0
11.99k stars 977 forks source link

'403 Forbidden' for wallpapercave #5925

Open Courage-1984 opened 3 months ago

Courage-1984 commented 3 months ago

I get '403 Forbidden' for wallpapercave.

I have tried with: --cookies-from-browser firefox and --user-agent browser and even -u "username" -p "password" <- with my actual credentials ofc.

Here is some log:


C:\Users\diete\Desktop\cli\yt>gallery-dl --cookies-from-browser firefox --user-agent browser "https://wallpapercave.com/apple-wwdc-2024-wallpapers" -v
[gallery-dl][debug] Version 1.27.1 - Executable (stable/windows)
[gallery-dl][debug] Python 3.8.10 - Windows-10-10.0.19045
[gallery-dl][debug] requests 2.31.0 - urllib3 2.1.0
[gallery-dl][debug] Configuration Files ['C:\\Users\\diete\\Desktop\\cli\\yt\\gallery-dl.conf']
[gallery-dl][debug] Starting DownloadJob for 'https://wallpapercave.com/apple-wwdc-2024-wallpapers'
[wallpapercave][debug] Using WallpapercaveImageExtractor for 'https://wallpapercave.com/apple-wwdc-2024-wallpapers'
[cookies][debug] Extracting cookies from C:\Users\diete\AppData\Roaming\Mozilla\Firefox\Profiles\v052ib16.Default User\cookies.sqlite
[cookies][info] Extracted 237 cookies from Firefox
[urllib3.connectionpool][debug] Starting new HTTPS connection (1): wallpapercave.com:443
[urllib3.connectionpool][debug] https://wallpapercave.com:443 "GET /apple-wwdc-2024-wallpapers HTTP/1.1" 403 None
[wallpapercave][error] HttpError: '403 Forbidden' for 'https://wallpapercave.com/apple-wwdc-2024-wallpapers
``'`
Hrxn commented 3 months ago

~I don't see any auth stuff in gallery_dl/extractor/wallpapercave.py..~

~Make sure it works in your browser, and then supply those cookies to gallery-dl and see if that works, please.~

Edit

Should have tried reading before.

Then it's probably just a site change.

mikf commented 3 months ago

This isn't a Cloudflare 403, so cookies + useragent are not going to help I think, even if both have the "correct" values. --cookies-from-browser sometimes doesn't extract all or the most recent cookies, --user-agent browser might return the wrong UA when multiple browsers are installed.

Furthermore, this wallpapercave page currently doesn't return any results anyway. Only "normal" wallpaper pages work.

$ gallery-dl https://wallpapercave.com/apple-wwdc-2024-wallpapers
[wallpapercave][info] No results for https://wallpapercave.com/apple-wwdc-2024-wallpapers

$ gallery-dl https://wallpapercave.com/w/wp10270355
wallpapercave/sekai-saikou-no-ansatsush…ni-tensei-suru-wallpapers-wp10270355.jpg