use `xargs` to `scp` in parallel

StormSurgeLive / asgs

The Automated Solution Generation System (ASGS) provides software infrastructure for automating coastal ocean modelling for real time decision support, and provides a variety of standalone command line tools for pre- and post-processing. Visit us at https://discord.gg/jFbacxrUf9

https://tools.adcirc.live

GNU General Public License v3.0

39 stars 22 forks source link

use `xargs` to `scp` in parallel #1197

Open wwlwpd opened 1 year ago

wwlwpd commented 1 year ago

this example uses rsync but the same principle applies

https://stackoverflow.com/questions/24058544/speed-up-rsync-with-simultaneous-concurrent-file-transfers

jasonfleming commented 1 year ago

This looks very handy. I can think of some other contexts where xargs could be used as well.