search

MeemeeLab / node-anime-viewer

Nodejs implementation of ani-cli.
Other
27 stars 6 forks source link

[Bug] Throttling problem #39

Open asdfugil opened 2 years ago

asdfugil commented 2 years ago

So, it looks like if you download too much with you get throttled to hell

But then going to the actual site and use inspect element to get the file url and referer and download it with curl using user agent 'jdjfirjrj/1' did not get throttled (super fast).

Using ani-cli download also has decent speed, depsite not being very fast.

MeemeeLab commented 2 years ago

It might be problem of server, some server are really slow and takes long time to download.

MeemeeLab commented 2 years ago

On my testing I did not get throttled.

asdfugil commented 2 years ago

It happenes after I downloaded about 35 episodes

asdfugil commented 2 years ago

OK so I tried download another anime today and the throttle happened after downloading only 11 episodes. It went from taking a few seconds to download an episode to 2 hours.

asdfugil commented 2 years ago

Plus the throttling happens in the middle of downloading another episode so it must be an intentional throttle.

asdfugil commented 2 years ago

curl with user agent + referer did not get throttled.

But even in the curl command I only used the https://example.com referer header, not the actual referer.