As discovered in #550 slurm on tacc seems to not allow (with obscure error message) batch array specification and uses Launcher (see #557 ) which was developed years ago, and possibly even not for SLURM initially (LSF?). Since apparently it could be quite common on well established HPCs, we should probably provide similar to launcher functionality to "serialize" job array execution where we would
either
mint per job "submit" script (instead of one with job array parameter) and then have sbatch calls per each one, or
mint sbatch invocations in a loop within submit which we run via sh not via sbatch
and we would need to provide "aggregation" helper to monitor "overall job", not individual ones
As discovered in #550 slurm on tacc seems to not allow (with obscure error message) batch array specification and uses Launcher (see #557 ) which was developed years ago, and possibly even not for SLURM initially (LSF?). Since apparently it could be quite common on well established HPCs, we should probably provide similar to launcher functionality to "serialize" job array execution where we would
either
submitwhich we run viashnot viasbatchand we would need to provide "aggregation" helper to monitor "overall job", not individual ones