search

ESPRI-Mod / synda

ESGF Downloader (this is a deprecated repository, the tool has now moved to https://github.com/ESGF/esgf-download)
https://espri-mod.github.io/synda/
21 stars 11 forks source link

Reduce priority for errors #113

Closed painter1 closed 5 years ago

painter1 commented 5 years ago

Reduce priority by 1 whenever status is changed to sdconst.TRANSFER_STATUS_ERROR. (This was already done in sdtask.py.) This ensures that a file which had a download error, will not be retried until the other files have been downloaded. This ensures that as many files as possible would be downloaded, even if a retry were issued immediately. Other desirable side effects, even after an immediate retry, are a delay between download attempts, and that errors tend to be near each other in the log file. This pull request addresses issue 82.

AtefBN commented 5 years ago

Thanks Jeff, this will be part of the next synda build on conda. (3.10 build 6)