Support containerized mpirun

aws-samples / aws-parallelcluster-post-install-scripts

Scripts to customize AWS ParallelCluster

MIT No Attribution

21 stars 13 forks source link

Closed verdimrc closed 4 months ago

verdimrc commented 11 months ago

Issue #, if available: #11

Description of changes:

enable containerized mpirun via srun --mpi=pmix --container-image haha.sqsh <CMD>
minor changes: enable the pytorch hook which sets torchrun's env vars (https://github.com/NVIDIA/enroot/blob/master/conf/hooks/extra/50-slurm-pytorch.sh)
bug fixes

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

verdimrc commented 5 months ago

@sean-smith could you review this? Once this in, I want to submit another fix for issue #20.