fast-failing singularity runs can absorb all the work

LSSTDESC / DESC_DC2_imSim_Workflow

BSD 3-Clause "New" or "Revised" License

3 stars 3 forks source link

fast-failing singularity runs can absorb all the work #16

Open benclifford opened 6 years ago

benclifford commented 6 years ago

when a singularity run fails fast on a broken node, that node can then end up absorbing all the work by executing-and-completing(failing) much faster than the other nodes

possibly parsl can be made to rate limit per worker node to make this less of a problem