nf-core / mcmicro

An end-to-end processing pipeline that transforms multi-channel whole-slide images into single-cell data.
https://nf-co.re/mcmicro
MIT License
4 stars 12 forks source link

Borrow ideas for how to design "restart" feature from sarek #37

Open jmuhlich opened 1 month ago

jmuhlich commented 1 month ago

Description of feature

Sarek has some nice logic to restart a previous run from a specific step in the pipeline. At each restart point in the pipeline, they emit a samplesheet into outdir that represents the state of the pipeline, potentially referencing other files in outdir. When a later run specifies the step param, the relevant samplesheet is automatically pulled out of outdir. This seems like a good way to implement the old mcmicro start-at feature while still retaining the separation of inputs and outdir.