Make file transfer faster for PromethION

NationalGenomicsInfrastructure / TACA

Tool for the Automation of Cleanup and Analyses: tools for projects and data management at NGI Stockholm

MIT License

14 stars 16 forks source link

Make file transfer faster for PromethION #365

Closed ssjunnebo closed 1 year ago

ssjunnebo commented 1 year ago

Use -u option for rsync to only update files that have not been transferred
Fix issue with existing folders in nosync

kedhammar commented 1 year ago

The nosync is still organized by experiment_id/sample_id/run_id, so don't we need to also include the sample ID as an intermediary directory in the archiving?

ssjunnebo commented 1 year ago

The nosync is still organized by experiment_id/sample_id/run_id, so don't we need to also include the sample ID as an intermediary directory in the archiving?

It should already do that

aanil commented 1 year ago

Rewritten in https://github.com/SciLifeLab/TACA/pull/368