Closed nwiltsie closed 5 months ago
If this is a boilerplate help template that you are copying into other pipelines:
2. For each Nextflow process: 1. Remove the `file ".command.*"` `output` directive. 2. Add `ext log_dir { ... }` and `ext log_sur_suffix { ... }` directives, if appropriate. 3. Remove the `publishDir` directive with `pattern: ".command.*"`.
Step 2 is misspelled and should be ext_log_dir_suffix
It should be ext log_dir: {...}
and ext_log_dir_suffix: {...}
(with the colon)
Without the colon, stdout will log an error but Nextflow will not exit with an error code.
We should incorporate the new
methods.setup_process_afterscript()
from https://github.com/uclahs-cds/pipeline-Nextflow-config/pull/64 into this pipeline.Under the new method, log files are automatically saved to
${params.log_output_dir}/process-log/${task.ext.log_dir}${task.ext.log_dir_suffix}/
(no need to specify apublishDir
directive).${task.ext.log_dir}
defaults to${task.process.replace(':', '/')}
.${task.ext.log_dir_suffix}
defaults to a blank string.The key steps are:
methods.setup_process_afterscript()
tomethods.setup()
.file ".command.*"
output
directive.ext log_dir { ... }
andext log_sur_suffix { ... }
directives, if appropriate.publishDir
directive withpattern: ".command.*"
.As an example, this
publishDir
directive... https://github.com/uclahs-cds/pipeline-align-DNA/blob/05275a7c81c9077e7f5fa41e48c7156494edfbdb/module/align_DNA_BWA_MEM2.nf#L35-L38... should be replaced with this directives:
See https://github.com/uclahs-cds/pipeline-recalibrate-BAM/pull/76/files for a full example.