User Request: Support for projects with many files

Duke-GCB / DukeDSClient

Command line program to allow uploading, downloading, and managing projects in the duke-data-service.

MIT License

5 stars 6 forks source link

User Request: Support for projects with many files #301

Closed johnbradley closed 4 years ago

johnbradley commented 4 years ago

ddsclient will allow you to upload projects with many files. When a project has over 10K files it can take several minutes to list the files. Our current recommendation has been to zip up small files to reduce the total number of files. A user requested some kind of mechanism to handle this issue.

johnbradley commented 4 years ago

Fixed by #295 The PR changed the download command to stream the list of files and download as soon as possible.