geoffxy / conductor

🎶 A simple and elegant research computing orchestrator.
GNU Affero General Public License v3.0
4 stars 0 forks source link

Run as much of a task as possible when there are failures #34

Closed geoffxy closed 3 years ago

geoffxy commented 3 years ago

Right now Conductor aborts a task the moment one of its dependencies fails. We should (by default) try to run as much of the task as possible (i.e., run the other dependent tasks in the task's transitive closure that don't rely on outputs of the failed task). We can also add a command line option to restore the existing "fail early" behavior.