search

LSSTDESC / DESC_DC2_imSim_Workflow

BSD 3-Clause "New" or "Revised" License
3 stars 3 forks source link

Filesystem optimization #31

Closed villarrealas closed 5 years ago

villarrealas commented 5 years ago

This PR sets up scripts and adds them to the Parsl workflow in order to:

1) Check a list of files to make sure they were transferred and, if not, transfer them and unpack them. 2) At the end of a run, give an automatic script that will transfer completed files to longterm storage - can also be run manually.

villarrealas commented 5 years ago

Fixed this so it now operates on Cori as desired.