Ensure batch/job cleanup is performing appropriately - Githubissues

CDLUC3 / mrt-doc

Documentation and Information regarding the Merritt repository

8 stars 4 forks source link

Ensure batch/job cleanup is performing appropriately #2069

Open terrywbrady opened 1 month ago

terrywbrady commented 1 month ago

Expectations

ZK library should decide if/when a batch can be deleted
If a job within a batch fails, the other jobs for that batch should stick around until the entire batch is resolved
the batch folder should be deleted as well (question, what triggers this action?)

Potential Issue

Mark created a job cleanup daemon. This was deleting jobs before the entire batch was resolved
On 10/16, Mark disabled this daemon

Potential questions

Is the batch cleanup in the zk library behaving as described above?
Is the batch folder delete getting triggered as needed?