search

L4cache / kemono-dl

(personal fork of) A simple kemono.party downloader using python.
93 stars 14 forks source link

About error 429 #30

Closed anon567321 closed 3 months ago

anon567321 commented 6 months ago

Hello, is it possible to reduce the frequency of error 429? For example, add a delay of half a second before loading the next chunk from api? I have over 300 artists in favorites, and now the "--user-updated-dateafter" function can run for hours because of the delay.

L4cache commented 6 months ago

Probably not. The server wants you to relax a bit, it's better to do that.

anon567321 commented 6 months ago

I mean, maybe if you don't access the api so quickly, the error rate will be lower? When all posts on a page are downloaded, a lot of api requests are made in a very short period of time, followed by a 120-second cooldown. Maybe we should add a small delay between requests, then the 120-second cooldown will not occur so often?

L4cache commented 6 months ago

That's possible...

L4cache commented 3 months ago

I guess ovear have dont it.