search

flatironinstitute / disBatch

Dynamic dispatch of a list of command-line tasks, locally or on a cluster. Supports retrying failed tasks, and adding/removing compute resources on-the-fly.
Apache License 2.0
39 stars 9 forks source link

Pass `--mpi=none` to srun invocation #31

Closed dylex closed 3 months ago

dylex commented 3 months ago

This will help ensure MPI tasks don't pick up the outer slurm context.

lgarrison commented 3 months ago

We actually already do (via environment variable instead of flag): https://github.com/flatironinstitute/disBatch/blob/b53729a0d6a84ddf8f336d9b831ba5bbd4e2a2aa/disbatchc/disBatch.py#L393

dylex commented 3 months ago

Oh, great, I only checked the srun line. Thanks.