It is not useful to retain Nextflow work subdirs from old pipeline runs that are no longer being used, so the make finalize-work-rm recipe should be run by default upon the successful completion of a pipeline under either the make run or Big Purple specific recipes. This will greatly reduce the amount of space used without compromising the 'resume' functionality. However, this recipe can take a long time to complete and produces a lot of stdout messages so some consideration needs to be made in its implementation to not bloat the tail of the run log, since thats the primary way to easily tell if the pipeline succeeded or not
It is not useful to retain Nextflow work subdirs from old pipeline runs that are no longer being used, so the
make finalize-work-rmrecipe should be run by default upon the successful completion of a pipeline under either themake runor Big Purple specific recipes. This will greatly reduce the amount of space used without compromising the 'resume' functionality. However, this recipe can take a long time to complete and produces a lot of stdout messages so some consideration needs to be made in its implementation to not bloat the tail of the run log, since thats the primary way to easily tell if the pipeline succeeded or not