mikf / gallery-dl

Command-line program to download image galleries and collections from several image hosting sites
GNU General Public License v2.0
11.33k stars 924 forks source link

rule34 Cloudflare challenge #4844

Open timeg7100 opened 9 months ago

timeg7100 commented 9 months ago

hi i have some issues with rule34 now ever time i try to download it give me this:

[rule34][warning] Cloudflare challenge [rule34][error] HttpError: '403 Forbidden' for 'https://api.rule34.xxx/index.php?page=dapi&s=post&q=index'

the image im trying to download is this : https://rule34.xxx/index.php?page=post&s=view&id=7996681

randumblai commented 8 months ago

wanna bump this, because this appears to now be a general problem for FurAffinity as well, even when using cookies. cf_clearance seems to be the most obviously relevant cookie, but doesn't seem to do anything after updating my cookie file to include it.

taskhawk commented 8 months ago

Seems to be happening with Danbooru for some images as well.

Edit: They are having bot issues so they are blocking all bots at the moment :/ https://danbooru.donmai.us/forum_topics/25845

mikf commented 8 months ago

To get around a "Cloudflare challenge":

If there's only one browser installed, the following should work (replace "firefox" with whatever browser you're using):

gallery-dl --user-agent browser --cookies-from-browser firefox "URL"

When there's no Cloudflare challenge for your browser and/or there's no cf_clearance cookie, you are out of luck.

The CF block on FurAffinity usually resolves itself within a few hours/days and I'm not getting one for rule34 either.