File download from a wide range of sources

Mizzou-CBMI / COSMOS2

Python Scientific Pipeline Management System

GNU General Public License v3.0

71 stars 39 forks source link

File download from a wide range of sources #29

Closed yassineS closed 8 years ago

yassineS commented 8 years ago

This is a great tool to get data from just about any cloud source: https://duck.sh

egafni commented 8 years ago

cool, does it do multi-part s3?

yassineS commented 8 years ago

They only list Multipart Uploads and Multithreaded downloads from S3. I think this package could be as failsafe option or at least recommended option for users that doesn't use S3.

egafni commented 8 years ago

sounds reasonable. I think this is more of a GenomeKey issue than Cosmos though, and a useful discussion for the Slack channel. Oren and I have been pretty active on slack/GenomeKey, just in PMs btw. I'm gonna close this and start a convo there