I suggest an opt-in option called flush which would nuke all intermediate files except icubes and icubed files at the end of the pipeline execution to save significant disk space for users (and make file navigation a bit easier). plots/ logs/ would remain intact as well as the proc file.
scizen9
commented
3 years ago
I suggest an opt-in option called flush which would nuke all intermediate files except icubes and icubed files at the end of the pipeline execution to save significant disk space for users (and make file navigation a bit easier). plots/ logs/ would remain intact as well as the proc file.