Closed elgalu closed 3 years ago
I'm sure it would be possible to create a similar Slurm plugin with a similar API than pyxis (i.e. --container-{image,name,mounts}
). But there is no plan to work on this as far as I know, feel free to start working on it if you want :)
Rootless docker still provides too much isolation by default which will be a problem for HPC workloads, and it uses slirp4netns (even with --net=host
) which will be detrimental to performance.
BTW, with pyxis you don't get the inconvenience "of having to convert to another container format", this is taken care behind the scenes (while still having the option to use a squashfs image).
Closing since this is not really a pyxis issue (would be a new project, and as I said there is no plan right now to work on that).
NVIDIA/deepops is adding support for rootless docker
Maybe it makes sense to think about a Slurm plugin that integrates with rootless docker instead of Enroot?