search

Duke-GCB / D4S2

Web service to facilitate notification and transfer of projects in DukeDS
MIT License
0 stars 0 forks source link

Allow zip downloads to start faster #241

Closed johnbradley closed 4 years ago

johnbradley commented 4 years ago

Batches file requests and uses zip.flush() so larger projects will begin downloading quicker. Uses batch size based on DukeDSClient config. Upgrades DukeDSClient to use simplified generator for fetching DDS files. Upgrades gcb-web-auth to be consistent with DukeDSClient version. Upgrades zipstream-new to use yield from zipfile.flush() so the zip file starts downloading when the first file is processed.

Fixes part of #222