Epic: GPU Support on SaaS

[atduarte]

Callout: Hey 👋 Are you interested in this feature? I would be interested in talking to you: https://calendly.com/andre-gitpod/15-minute-product-feedback

---

We want to fully support GPUs to enable different workloads, such as data science, particularly on self-hosted installations.

Open questions:

• [x] Would we be able to dynamically assign GPUs to workspaces? Not right now
• [x] Would we be able to share one GPU between multiple workspaces? Preferably not right away, given performance and security concerns [video]
• [x] Would we be able to support all types of GPUs or would need to select a subset? What subset? Given the focus on SaaS, we will just pick one and go with that.
• [x] Are we able to confidently release GPU support for self-hosted without launching it also on SaaS? No
• [ ] Is there a limitation on what and how many GPUs you can attach to a given instance type? We will need to research, maybe there are. Depending on that we might want one workspace per node, or multiple workspaces per node with multiple GPUs.

Options:

• Just another class — We don't share GPUs across workspaces. We have a separate node pool / workspace class that has a defined workspace density, which equals the number of GPUs. We would launch on SaaS first, as we need to

Concerns:

• Workspace classes are hard-coded in server. Probably resolved in #8261.
• The user will have to keep on changing their user settings to use GPUs or not. We should have workspace class project setting. And in the future, it might make sense to allow Data Scientist to select whenever they open the workspace or inside the workspace.

Dependencies:

• (for self-hosted) Self-hosted will need to be able to configure multiple workspace classes.
• (Preferably) Per project workspace class setting.
• (Must) Possibility of scaling a node pool to zero.

Things we know we will have to do:

• https://github.com/gitpod-io/gitpod/issues/8396
• To mount the GPU device in the workspace. Probably replicate the work we did for the fuse device.

Related request: https://github.com/gitpod-io/customers/issues/24

[sheffier]

Really expecting to try GPU support! please ping me as soon as it can be tested

[singhsidhukuldeep]

Can't wait to try GPUs. Please update as soon as we can try 😃

Also as a small request can we have CUDA enabled GPUs with CUDA already working out of the box?

[KangOxford]

Please ADD GPU support!!! I will pay the bill.

[knshkp]

Please ADD GPU support

[stale[bot]]

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

[julien-blanchon]

Any news on this ?