search

NiiMiyo / EDOPro-Hd-Downloader

Downloads HD cards arts images for ProjectIgnis: EDOPro
MIT License
41 stars 4 forks source link

Improved performance by using threading and batch download #15

Closed AndrinoC closed 4 months ago

AndrinoC commented 4 months ago

Hey, I took some time and made some improvements.

The script now takes up to 2 minutes to download all images on 16 workers setup.

I managed to achieve this by analyzing Teddy-Kun's fork of your script and improving it.

AndrinoC commented 4 months ago

It is way faster and I faced no issue with the API such as throttling/breaking. If needed I can implement a ratelimit, but for now this code works fine up to 16 workers.