maxplanck-ie / snakepipes

Customizable workflows based on snakemake and python for the analysis of NGS data
http://snakepipes.readthedocs.io
MIT License
374 stars 85 forks source link

sbatch: error: Batch job submission failed: Node count specification invalid #929

Closed sunta3iouxos closed 11 months ago

sunta3iouxos commented 11 months ago

This is one of the errors:

rule origFASTQ2:
    input: /home/tgeorgom/fastq/AP01/A006200317_201090_S26_L000_R2_001.fastq.gz
    output: originalFASTQ/A006200317_201090_S26_L000_R2_001.fastq.gz
    jobid: 54
    reason: Missing output files: originalFASTQ/A006200317_201090_S26_L000_R2_001.fastq.gz
    wildcards: sample=A006200317_201090_S26_L000
    resources: mem_mb=1325, disk_mb=1325, tmpdir=<TBD>

sbatch: error: Batch job submission failed: Node count specification invalid
Error submitting jobscript (exit code 1):

This is the relevant entry from the cluster.yalm from the shared/ folder

snakemake_latency_wait: 300
snakemake_cluster_cmd: sbatch --ntasks-per-node 1 -p smp-rh7 -A tgeorgom  --mem-per-cpu {cluster.memory} -c {threads} -e {snakePipes_cluster_logDir}/{rule}.%j.err -o {snakePipes_cluster_logDir}/{rule}.%j.out -J {rule}
snakePipes_cluster_logDir: cluster_logs

When I run cellranger for example the following settings are set:

#SBATCH -J __MRO_JOB_NAME__
#SBATCH --export=ALL
**#SBATCH --nodes=1 --ntasks-per-node=__MRO_THREADS__**
#SBATCH --signal=2
#SBATCH --no-requeue
#SBATCH --mem=__MRO_MEM_GB__G
#SBATCH -o __MRO_STDOUT__
#SBATCH -e __MRO_STDERR__
#SBATCH -t 48:00:00
#SBATCH -A tgeorgom
#SBATCH -p smp-rh7

how can I set the "__MRO_THREADS__" variable in a way to reflect the asked threads for each "rule" in snakePipes? MAybe this is the error?

sunta3iouxos commented 11 months ago

fixed it I replaced the --ntasks-per-node 1 with --nodes=1