search

mikf / gallery-dl

Command-line program to download image galleries and collections from several image hosting sites
GNU General Public License v2.0
11.33k stars 924 forks source link

Problem downloading from readcomiconline/Cloudflare Challenge #6070

Open kendrakirai opened 3 weeks ago

kendrakirai commented 3 weeks ago

So, I'm unable to get past the Cloudflare challenge with readcomiconlinne, no matter what I've found to try. Exported cookies, used the captcha check url I found here (Which isn't appearing any more), the user agent doesn't seem to be doing anything...

The challenge doesn't appear on Firefox anymore, but using the cookies from it - even exported to file - isn't doing anything. (Log 2 is after I've tried even more things.)

readcomicfail-2.log

readcomicfail.log

mikf commented 3 weeks ago

The challenge doesn't appear on Firefox anymore

You need to visit an issue reader page for it, it seems. https://readcomiconline.li/Comic/Nightwing-2016/Issue-117?id=232825

even exported to file - isn't doing anything.

Make sure your cookies include a cf_clearance cookie. The --user-agent needs to be the same as your browser's as well.

kendrakirai commented 3 weeks ago

The cf_clearance appears to be set - it's an incredibly long strong and it's marked TRUE.

How do I set the user agent?

Hrxn commented 3 weeks ago

https://gdl-org.github.io/docs/configuration.html#extractor-user-agent

Note, if you set "user-agent" directly in "extractor", it will be used for all sites - unless overridden in a specific extractor.

kendrakirai commented 2 weeks ago

I've updated the user agent string to my version of firefox, which I'm using the cookies of, and it's still halting at the captcha - but not the cloudflare challenge at least, just a redirect. Doing them doesn't help, it just redirects again. But that did get past the challengee it seems, so I guess the site is just un-downloadable.