opendatahub-io-contrib / jupyterhub-singleuser-profiles

MIT License
11 stars 24 forks source link

Add in a gpu node soft anti-affinity for pods that don't request GPUs #222

Closed Xaenalt closed 2 years ago

Xaenalt commented 2 years ago

This commit adds in a soft anti-affinity for nodes tagged as GPU nodes by the Nvidia GPU operator. When creating a pod that doesn't request any GPUs, it will have an affinity added that avoids GPU tagged nodes if possible. If there are no available nodes that satisfy that requirement, it will allow scheduling onto the GPU nodes to avoid a scheduling failure.

LaVLaS commented 2 years ago

@Xaenalt I built a jupyterhub image that pulls in this change but it does not appear to apply any node affinity for CPU nodes. Can you build a JupyterHub image with these PR changes for review?

Xaenalt commented 2 years ago

For an update, this does seem to need an extra pass, when Landon gets back we'll look into why the build didn't work