Duke-GCB / DukeDSClient

Command line program to allow uploading, downloading, and managing projects in the duke-data-service.
MIT License
5 stars 6 forks source link

simplify downloading #295

Closed johnbradley closed 4 years ago

johnbradley commented 4 years ago

Downloads each file in a single process. Changes downloading to make progress as soon as possible. Reads the DDS files API using a python generator to minimize the need to re-create a download url. MD5 hashing is now done in a background process instead of the foreground process. Changes the download progress bar to include progress download files. Users will now be able to monitor file size when downloading.

Adds file_download_retries config file option that defaults to 5 retries.

Download files in single process which was a problem on some windows machines - Fixes #282 Updates progress bar to show bytes downloaded and complete file progress.