fix: gpu acceleration windows - Githubissues

containers / podman-desktop-extension-ai-lab

Work with LLMs on a local environment using containers

https://podman-desktop.io/extensions/ai-lab

Apache License 2.0

170 stars 31 forks source link

fix: gpu acceleration windows #1635

Closed axel7083 closed 1 month ago

axel7083 commented 1 month ago

What does this PR do?

See https://github.com/containers/podman-desktop-extension-ai-lab/issues/1588#issuecomment-2321339768 for explanation

Screenshot / video of UI

https://github.com/user-attachments/assets/3d790cb4-5471-4520-b1d8-fd3d733fd5b9

What issues does this PR fix or reference?

Fixes https://github.com/containers/podman-desktop-extension-ai-lab/issues/1588

How to test this PR?

assert have an nvidia GPU
assert have experimental gpu enabled
start an inference server
in inference server logs see your gpu