databio / pypiper

Python toolkit for building restartable pipelines
http://pypiper.databio.org
BSD 2-Clause "Simplified" License
45 stars 9 forks source link

Rerun of downstream `Stage`s should be configurable, probably opt-in #224

Open vreuter opened 4 months ago

vreuter commented 4 months ago

With a nofailed Stage now not writing a checkpoint (correct, IMO), Stages downstream will be run even if they've already been done. Typically, I'll be marking a stage as nofail only if it has no downstream dependent tasks, so in general I don't want these rerun if I just rerun a nofailed stage to "fill in" the pipeline's steps.