search

mikf / gallery-dl

Command-line program to download image galleries and collections from several image hosting sites
GNU General Public License v2.0
10.66k stars 880 forks source link

[patreon] Cloudfare challenge #5731

Closed ZenoArrows closed 1 week ago

ZenoArrows commented 1 week ago

I'm getting cloudflare challenges both with gallery-dl and with Firefox, but only when using Ubuntu. If I use gallery-dl on my Windows PC from the same IP I do not get any challenge. Spoofing the user-agent and using the cookies from my Windows PC does not resolve the issue.

When using Firefox on my Ubuntu machine I can pass the cloudflare challange without having to solve a captcha, but using its cookies and user-agent does not prevent the challenges either. I've also tried simply waiting a few days without attempting to scrape patreon, but the issue persists.

I've also tried adding -o tls12=false to the command-line, but it has no effect. Though it would make sense if some kind of difference between the TLS implementation on Windows and Ubuntu triggers it.

ZenoArrows commented 1 week ago

Not sure what cloudflare fingerprinted about my system, but I was able to solve this by reinstalling the OS.

mikf commented 1 week ago

If this happens again, it should be possible to change fingerprints with tls12 and ciphers options. browser and headers might also help.