search

cgat-developers / cgat-flow

cgat-flow repository
MIT License
13 stars 9 forks source link

Alternate pipeline paths and checksums #149

Open IanSudbery opened 2 years ago

IanSudbery commented 2 years ago

Hi Guys,

Don't know if this belongs here or on ruffus, but if I run my pipelines with -c3 then change the configurations so the pipelne follows a different flow, then it doesn't recognise the change. E.g:

If I run the readqc pipeline with no processors:

cgatflow readqc make full -c3

Then I look at the results and decide to add a processor, and rerun, the pipeline still goes for the dummy processRead task, not the real one.

IanSudbery commented 2 years ago

ping @AndreasHeger

AndreasHeger commented 2 years ago

Thanks, @IanSudbery , this is a ruffus issue, but we can track here. I have not yet looked into the checkpointing system, might be a good time to start.