403 Forbidden Error when trying to download from kemono.party and coomer.party

[man700]

[kemonoparty][error] HttpError: '403 Forbidden' for 'https://kemono.party/fantia/user/6188' [downloader.http][warning] '403 Forbidden' for 'https://coomer.party/data/4a/3f/4a3fccc0f314383fb1782bc238cae658a8583d4735a680f05ecaa22f4a39367e.jpg' [download][error] Failed to download 496961298_warning this photo will make you want to lick your screen!!_01_827fcc52-7ba8-4190-95c0-993af9f48ec5.jpg

For some reason enabling cookies allows downloads to go through but trying to do it without them just leads to the above error.

[ClosedPort22]

I've been seeing random 403 errors for the past couple of weeks as well, and the error responses all seem to be 11279 bytes long. I can manually re-download the URLs afterward using wget though.

[biggestsonicfan]

Was getting 403's on Kemono. Added user-agent and browser to my kemono settings and updated my cookie. Seems to have done the trick for now.

EDIT: Nevermind, VPN it is for now

EDIT2: Huh, look at this...

[ClosedPort22]

Was getting 403's on Kemono. Added user-agent and browser to my kemono settings and updated my cookie. Seems to have done the trick for now.

EDIT: Nevermind, VPN it is for now

EDIT2: Huh, look at this...

The site still works perfectly fine for me. Try using sleep and sleep-request. DDOS-Guard may have temporarily blacklisted your IP address.

[biggestsonicfan]

I use both, but they may not be long enough intervals. I am thinking my IP may be blacklisted for now so still VPN it is.

[alexolog]

Also getting 403. Cookies match browser. Suggestions?

[ClosedPort22]

Also getting 403. Suggestions?

Use the retry-codes option and set retries to 10+. sleep and sleep-request would probably help too.

[alexolog]

Setting the referer helped for a bit, but after a couple of hundred files got downloaded, I started getting 403 errors again, and after about a 100 of those (the window was running in the background), my IP got blocked - I am getting timeouts even from a browser, while accessing via a proxy works OK.

Hopefully it is temporary.

[biggestsonicfan]

Already off the vpn with no issues thus far. Bumped sleep and sleep-request from 2.0 to 6.0

EDIT: 5 hours later, spoke too soon, everything 403's, back to VPN, will bump sleep to 10.0

Swapping to 4 diff vpns now, all 403ing.

EDIT2: Eevermind, appears to be a specific issue to patreon 99312

[vlf]

"sleep": 10, "sleep-request": 10, no vpn - still getting issues, sometimes on the very first extractor request after starting app.

[reyaz006]

How do I use retry-codes? Have this and it just skips the artist as soon as it gets the 403 error.

    "extractor": {
        "kemonoparty": {
            "retries": 10,
            "retry-codes": [404, 429, 430, 403],

Also how do I troubleshoot? I want to get the output with headers and response. Everything is fine in browser under the same IP and cookies but only 403 errors in gallery-dl without any details.

[ClosedPort22]

How do I use retry-codes? Have this and it just skips the artist as soon as it gets the 403 error.

Are you using the latest release? Your config file seems OK.

Also how do I troubleshoot? I want to get the output with headers and response.

Use -o write-pages=all. The files will be saved to your working directory.

[reyaz006]

Are you using the latest release? Your config file seems OK.

>gallery-dl --version
1.24.4

>gallery-dl https://kemono.party/fanbox/user/3316400
[kemonoparty][error] HttpError: '403 Forbidden' for 'https://kemono.party/fanbox/user/3316400'

>

Use -o write-pages=all

Thanks, now I see this is indeed the ddos-guard page.

[mikf]

The general version of retry-codes will be in v1.24.5 once it's released.

[valdearg]

Should be sorted now, KP admin made some changes.

[LurkerHub]

Should be sorted now, KP admin made some changes.

Does it mean that we can remove retries, sleeps, and other workarounds from our configs?

[MonokaiSenti]

They have created a new standard now. If you want to use Gallery-dl without getting banned, email your IP address to hermietkreeft@kemono.party to be whitelisted, or else you will be banned from downloading or accessing the website.

[ClosedPort22]

If you want to use Gallery-dl without getting banned, email your IP address to hermietkreeft@kemono.party to be whitelisted, or else you will be banned from downloading or accessing the website.

It doesn't look like they're saying that you need to get your IP whitelisted before you can use gallery-dl. It might be helpful to enable sleep by default if users still report getting blocked while using gallery-dl, so it'll be up to the user to decide if they want to take that risk.

FWIW, I typically set sleep-request and sleep to 7 since I run gallery-dl overnight. Annoying as they are, these 403 errors never caused any real problems for me.