Closed RickKessler closed 3 years ago
Scaffolding this out - we should define in the cfg.yml
a default BATCH_JOB template that points to one of Ricks template files. We can then pass this to all the BATCH_INFO, and use the NCORE argument added to allow for easy changing of the number of jobs without resubmitting anything.
We can then use the BATCH_INFO file in #15 (for SNIRF, NN, others) instead of having our own batch keys
--ncore argument ready; see https://github.com/RickKessler/SNANA/issues/300
So heres how I'd break this task down:
This has been added
Would be really useful to specify GLOBAL: BATCH_INFO: sbatch $PIPPIN_BASE/SBATCH_Cori.TEMPLATE 10
and then remove all of the other BATCH_INFO keys, or replace them with NCORE: 20 to change number cores but keep same SBATCH file. To make this easier to implement, I will modify submit_batch_jobs to accept a new arg, --ncore
which overrides NCORE from input file.