LRGASP / lrgasp-submissions

Definition and validators for LRGASP submissions
MIT License
8 stars 2 forks source link

Define process for transfering files, recommend tools. #6

Closed diekhans closed 3 years ago

diekhans commented 4 years ago

this looks promissing https://rclone.org/

julienlag commented 4 years ago

Agreed. WRT downloads, at least provide direct links for wget/curl for genome, annotations etc. as well as md5 checksums. It may also be a good idea to compress those files (downloading from Spain is dead slow right now).

julienlag commented 4 years ago

Andrey suggested this tool: https://github.com/odeke-em/drive#drive

diekhans commented 4 years ago

There is also: https://rclone.org/

I haven't used it.

I am a bit worried that this quantity of data is beyond what google drive is design for.

julienlag commented 4 years ago

I agree with Mark

diekhans commented 3 years ago

using synapse