xtream1101 / humblebundle-downloader

Download you Humble Bundle Library
MIT License
543 stars 63 forks source link

Is there a way to circumvent throttling? #36

Open sdfjsfjaei-hans opened 3 years ago

sdfjsfjaei-hans commented 3 years ago

First of all thank you for creating this amazing tool!

I have a pretty big library and for hours it downloaded fine, but now it downloads at an extremely slow speed.

Screenshot_20210422_124848

A small pdf takes about half an hour.

However, when I download over the humble bundle interface, the speed is a lot faster (about 5 mbps).

What I tried

I started using the cookie file, while also copying the headers of my browser session to the requests session (self.session.headers.update(HEADERS) - logging enabled, so I see the correct headers are sent), but this seemed to have no effect.

sdfjsfjaei-hans commented 3 years ago

Hmm.. it went through. Seemed like only certain files were affected (irrespective of file size).

dylanmtaylor commented 2 years ago

It might be that they're using a CDN for distribution and certain files aren't cached.