Computational-Plant-Science / plantit

https://plantit.cyverse.org
BSD 3-Clause "New" or "Revised" License
11 stars 5 forks source link

Task orch refactor #281

Closed wpbonelli closed 2 years ago

wpbonelli commented 2 years ago

This PR includes a large backend refactor. We no longer require the plantit-cli on deployment targets, opting instead to reduce the clusterside dependency footprint to SLURM and Singularity. We now use an iCommands container image for data transfers, and either the TACC Launcher (if available) or SLURM job arrays to submit containers in parallel.