search

AlphaSlayer1964 / kemono-dl

A simple kemono.party downloader using python.
508 stars 81 forks source link

DDOS Protection - Too many requests #170

Open Akalil-H opened 1 year ago

Akalil-H commented 1 year ago

I dont whether this is server issue or program issue. It's like server already implement DDOS protection.

PS F:\Kemono DL> python kemono-dl.py --cookies "cookie.txt" --links https://kemono.party/fanbox/user/5579659 INFO:Downloading posts from kemono.party.party | fanbox | hagure-oekaki | 5579659 INFO:Downloading Post | (R-18)珍しいお宝 INFO:Downloading: 1_30eae496-63d6-401d-8796-f5d055ced9b1.jpg WARNING:Failed to download: 1_30eae496-63d6-401d-8796-f5d055ced9b1.jpg | 429 Too Many Requests | Sleeping for 120 seconds

moofmoof02 commented 1 year ago

I having this problem too. Though I'm using the fork from rum416 (https://github.com/rum416/kemono-dl) since the latest version having another problem (TypeError: strptime() argument 1 must be str, not float).

And kemono seem to have some kind updates right? I have not been using the web for a few months now.

L4cache commented 1 year ago

kemono is in maintenance, maybe it's the cause?

ILogOutOnTheToilet commented 1 year ago

@Akalil-H @moofmoof02 Can you test out my PR changes by adding --download-timeout 4 parameter and seeing if you still get the error? It will sleep for 4 second between each file download. I suspect this is due to downloading each file in a post too fast. Currently the code doesn't pause between downloading attachments or inline images, and may be violating some rate limit. This has led to me being blocked from kemono.party servers for a few hours, but I fixed it with my PR.

Here is the PR: https://github.com/AlphaSlayer1964/kemono-dl/pull/177

Normiegetout commented 1 year ago

@Akalil-H @moofmoof02 Can you test out my PR changes by adding --download-timeout 4 parameter and seeing if you still get the error? It will sleep for 4 second between each file download. I suspect this is due to downloading each file in a post too fast. Currently the code doesn't pause between downloading attachments or inline images, and may be violating some rate limit. This has led to me being blocked from kemono.party servers for a few hours, but I fixed it with my PR.

Here is the PR: #177

Hey, I just had to find my login info to say big thanks for this. Works perfectly even with just --download-timeout 2