I have a snakemake pipeline which I run with the --slurm flag. Everything is working fine. However, I was unable to include a cluster status script with --cluster-status. Alhough the pipeline does not produce any errors when using --cluster-status, the cluster status script does not produce any output. However, the same script IS functional when I run the pipeline without the --slurm flag. Unfortunately, this is not an option, as then I get the "some output files are missing" for some rules.
This never happens, when including the --slurm flag.
So here is the short form:
snakemake -s ccs_new.smk --profile simple/ --cluster-status ./extras/status-sacct.py
Pro: status script works
Contra: MissingOutputException error screws up the whole pipeline
snakemake -s ccs_new.smk --profile simple/ --cluster-status ./extras/status-sacct.py --slurm
Pro: pipelines finishes without error
Contra: status script does not produce any output
I guess , I would also appreciate an explanation of what exactly the --slurm flag does? Because in both cases (also without the flag), jobs are submitted to the cluster. I just started using snakemake in combination with slurm, so perhaps I have a misunderstanding here.
I have a snakemake pipeline which I run with the
--slurm
flag. Everything is working fine. However, I was unable to include a cluster status script with--cluster-status
. Alhough the pipeline does not produce any errors when using--cluster-status
, the cluster status script does not produce any output. However, the same script IS functional when I run the pipeline without the--slurm
flag. Unfortunately, this is not an option, as then I get the "some output files are missing" for some rules. This never happens, when including the--slurm
flag.So here is the short form:
snakemake -s ccs_new.smk --profile simple/ --cluster-status ./extras/status-sacct.py
Pro: status script works Contra: MissingOutputException error screws up the whole pipelinesnakemake -s ccs_new.smk --profile simple/ --cluster-status ./extras/status-sacct.py --slurm
Pro: pipelines finishes without error Contra: status script does not produce any outputWhat is going on?
For more information, here is my profile config:
I guess , I would also appreciate an explanation of what exactly the --slurm flag does? Because in both cases (also without the flag), jobs are submitted to the cluster. I just started using snakemake in combination with slurm, so perhaps I have a misunderstanding here.