To upload ~500TB of data.

NDAR / nda-tools

Python package for interacting with NDA web services. Used to validate, submit, and download data to and from NDA.

MIT License

48 stars 21 forks source link

To upload ~500TB of data. #90

Open vg249 opened 9 months ago

vg249 commented 9 months ago

Hi,

We have a use case where we need to upload around 60K files of total size around ~500TB to NDA. Looking for examples and references to optimize performance and reduce the amount of time to upload data into NDA.

Thank you.