search

CCBR / CHAMPAGNE

CHromAtin iMmuno PrecipitAtion sequencinG aNalysis pipEline
https://ccbr.github.io/CHAMPAGNE/
MIT License
0 stars 2 forks source link

Group low-resource tasks together in one slurm job? #91

Open kelly-sovacool opened 1 year ago

kelly-sovacool commented 1 year ago

In snakemake you can group multiple jobs of the same rule or multiple rules together in one cluster job, e.g. if you have rules that require few resources, this helps reduce time wasted in the cluster queue.

Is it possible to do this in nextflow? The jaccard index process would be a good candidate for this.

Edit: nextflow does not yet support this, but they're working on it. https://www.github.com/nextflow-io/nextflow/pull/3909

slsevilla commented 7 months ago

shouldve searched through the issues but yes - this!

kelly-sovacool commented 7 months ago

now if only the nextflow maintainers would just merge that PR already 😅