uclahs-cds / pipeline-call-gSV

Nextflow pipeline to call germline structural variants and copy number variants using DELLY and Manta
https://uclahs-cds.github.io/pipeline-call-gSV/
GNU General Public License v2.0
2 stars 1 forks source link

Optimize Manta CPU #161

Closed Faizal-Eeman closed 5 months ago

Faizal-Eeman commented 5 months ago

Description

Increment CPU allocation for Manta.

The increments in this PR were primarily adapted from pipeline-call-sSNV and tailored to pipeline-call-gSV's requirements.

Closes #154

Testing Results

Node Sample BAM Size Old Runtime (CPU = 1) New Runtime (CPU = n)
F16 HG003-5X 21G 1h 27m 11m 38s
F32 ILHNLNEV000002-N001-B01-F 85GB 7h 38m 34m
F72 ZMBNGIAB000008-N001-A01-F 369GB >20h still running 6h 1m

output dir: /hot/software/pipeline/pipeline-call-gSV/Nextflow/development/unreleased/mmootor-optimize-manta-cpu/

Checklist

github-actions[bot] commented 5 months ago

Bleep bloop, I am a robot.

Alas, some of the Nextflow configuration tests failed!

test/configtest-F16.json

@ ["params","proc_resource_params","call_gSV_Manta","cpus"]
- "1"
+ "6"
@ ["process","withName:call_gSV_Manta","cpus"]
- "1"
+ "6"

If the above changes are surprising, stop and determine what happened.

If the above changes are expected, there are two ways to fix this:

  1. Automatically: Post a comment starting with "/fix-tests" (without the quotes) and I will update the tests for you (you must review my work afterwards).
  2. Manually: Follow these steps on Confluence.
yashpatel6 commented 5 months ago

/fix-tests

github-actions[bot] commented 5 months ago

Bleep bloop, I am a robot.

I have updated all of the failing tests for you with 4b7584bd8c6c8f01ff0891ffbb1d34d888567a33. You must review my work before merging this pull request!

Faizal-Eeman commented 5 months ago

Any reason to only update the F16 and F32 configs and not the rest?

@yashpatel6