fls-bioinformatics-core / auto_process_ngs

Scripts and utilities for automatic processing & management of Illumina NGS sequencing data.
Other
9 stars 7 forks source link

Optimise copying final data for some tasks in QC pipeline #942

Closed pjbriggs closed 8 months ago

pjbriggs commented 8 months ago

Updates some of the tasks in the QC pipeline so that checking and copying of the final outputs is performed within the command scripts, rather than being deferred to the finish method of the task.

Specifically the following tasks have been updated:

For tasks such as running cellranger count, prior to this update a failure in one command would mean that none of the outputs were copied to the final destination (meaning that all outputs would have to be regenerated if the pipeline was rerun).

With this change, even if one command in a task fails to complete, the outputs for those that completed successfully will be copied and should not have to be regenerated when rerunning.