search

emissions-api / sentinel5dl

Sentinel-5(P) Downloader
https://sentinel5dl.emissions-api.org
MIT License
12 stars 8 forks source link

Download product with multiple workers #57

Closed shaardie closed 4 years ago

shaardie commented 4 years ago

This patch introduces workers for downloading files using the executable. For programs using the library the parallelization should be done in the calling code itself.

There could be a lot of md5sums to process when working on long download periods. Therefore multiprocessing is used to be able to calculate those hashes on multiple cores.