Detecting GPU(s) on Linux (Name, VRAM)

containers / podman-desktop-extension-ai-lab

Work with LLMs on a local environment using containers

https://podman-desktop.io/extensions/ai-lab

Apache License 2.0

181 stars 41 forks source link

Detecting GPU(s) on Linux (Name, VRAM) #2162

Open axel7083 opened 3 days ago

mhdawson commented 21 hours ago

Initial work to get GPU acceleration working for linux

https://github.com/containers/podman-desktop-extension-ai-lab/pull/2180
https://github.com/podman-desktop/podman-desktop/pull/10166

The only environment that I can run/develop recipes effectively with a GPU is linux so I wanted to see how hard it was to get running, with the hope the time I invested save me time working on future Node.js recipes.