search

NVIDIA / pyxis

Container plugin for Slurm Workload Manager
Apache License 2.0
273 stars 31 forks source link

Slurm plugin with rootless docker (instead) #38

Closed elgalu closed 3 years ago

elgalu commented 3 years ago

NVIDIA/deepops is adding support for rootless docker

Maybe it makes sense to think about a Slurm plugin that integrates with rootless docker instead of Enroot?

Alternatives, such as Singularity and Enroot, also enable an unprivileged user to utilize containerization. The added convenience of rootless docker is that if one is working with docker containers it would be more straightforward to build and run docker containers instead of having to convert to another container format.

flx42 commented 3 years ago

I'm sure it would be possible to create a similar Slurm plugin with a similar API than pyxis (i.e. --container-{image,name,mounts}). But there is no plan to work on this as far as I know, feel free to start working on it if you want :)

Rootless docker still provides too much isolation by default which will be a problem for HPC workloads, and it uses slirp4netns (even with --net=host) which will be detrimental to performance.

BTW, with pyxis you don't get the inconvenience "of having to convert to another container format", this is taken care behind the scenes (while still having the option to use a squashfs image).

flx42 commented 3 years ago

Closing since this is not really a pyxis issue (would be a new project, and as I said there is no plan right now to work on that).