create a Slurm accumulator job that waits for completion of array job

[christopheredsall]

Sketch of design. Use the --paresable flag to sbatch to get the job id as a bash variable, e.g.

[cje57@login-e-1 slurm-requests]$ JOB1=$(sbatch --parsable dummy.sh )
[cje57@login-e-1 slurm-requests]$ echo $JOB1
23874559

Have a run_workflow.sh that does something like

#!/bin/bash

# Submit three slurm jobs to do the end to end processing

# Pre-processing
PRE=$(sbatch --parsable pre-script)

# Per file processing as array job
PROC=$(sbatch --parsable --dependency=afterok${PRE} )

# Post-processing (accumulation)
POST=$(sbatch --parsable --dependancy=afterok${POST} )