GPU in container

[syoh]

Might be useful info for enabling GPU use in containers: https://wiki.engineering.osu.edu/display/DOCS/Rootless+Docker+Setup+Instructions

[392781]

Useful links for future:

• https://gist.github.com/bernardomig/315534407585d5912f5616c35c7fe374
• https://www.redhat.com/en/blog/how-use-gpus-containers-bare-metal-rhel-8
• https://docs.nvidia.com/datacenter/cloud-native/container-toolkit/latest/install-guide.html#configuring-podman

[392781]

Podman requires additional configuration to run GPUs... Jetstream2 provides GPU access but I would need access to a GPU instance to develop the necessary additions to create a Podman compatible GPU image for Jetstream2.

[syoh]

The following works with EL9 + Podman (Roble).

• On host, follow the setup procedure
• In .devcontainer/devcontainer.json, add to runArgs:
  • "--device=nvidia.com/gpu=all"
  • "--security-opt=label=disable"

[392781]

Excellent, I can modify the template to include a question about GPU configuration!

[392781]

It's very nice that this is a simple process... The podman requirements on nvidia made it look a bit nasty.

[syoh]

GPU and Singularity container from Jupyter-like containers: https://github.com/pangeo-data/pangeo-docker-images/blob/master/Sing+GPU.md