search

sanger-bentley-group / GBS-Typer-sanger-nf

GBS Typer Pipeline in Nextflow
GNU General Public License v3.0
0 stars 1 forks source link

Added an LSF configuration #27

Closed kpepper closed 3 years ago

kpepper commented 3 years ago

Running multiple parallel bsubs on the pipeline directory is not recommended. Therefore I've added an LSF profile to enable nextflow to manage the scheduling itself. This significantly improves performance for a large number of samples. The max number of jobs allowed to run at any one time is set to 20 by default, but this can be changed as required in the nextflow.config. A retry policy has also been added. See README for details.

puethe commented 3 years ago

This looks like it'll be extremely useful, thanks Kev!