opendatahub-io-contrib / jupyterhub-singleuser-profiles

MIT License
11 stars 24 forks source link

JupyterHub shared memory for deep learning #213

Open ViitasaariVille opened 2 years ago

ViitasaariVille commented 2 years ago

Hi, would it be possible in the future to mount an shm-volume using the singleuser-profiles config map? This would be needed to do efficient deep learning with pytorch. Examples can be found e.g. in https://zero-to-jupyterhub.readthedocs.io/en/latest/jupyterhub/customizing/user-resources.html, https://docs.openshift.com/online/pro/dev_guide/shared_memory.html but I was unable to mount the shm-volume in https://github.com/opendatahub-io/jupyterhub-singleuser-profiles. Maybe I was just dong sth wrong?

What I tried to do was add this in the jupyterhub-singleuser-profiles-configmap: volumes:

I managed to get this as a global config by adding the volume in https://github.com/opendatahub-io/odh-manifests/blob/master/jupyterhub/jupyterhub/base/jupyterhub-configmap.yaml via jupyterhub_config.py but it could be useful to be able to configure this differently for different users.