Cannot Use GPU With Kubeflow AKS

[tfontana1]

Cannot use GPU when deploying a new notebook on Kubeflow.

1. Created a GPU node pool following this guide: https://learn.microsoft.com/en-us/azure/aks/gpu-cluster?tabs=add-ubuntu-gpu-node-pool

2. Create new notebook and give it access to 1 Nvidia GPU

3. Notebook deployment is failing with this error on the kubernetes pod:

The notebook server never deploys and crash loops. I am able to run the GPU test example in the microsoft tutorial so I know that the GPU on AKS is configured properly.

[seenu433]

The cluster should be on a SKU that supports GPU. https://learn.microsoft.com/en-us/azure/aks/gpu-cluster?tabs=add-ubuntu-gpu-node-pool

The construction set can be updated to add a new node pool with GPU SKUs