search

containers / podman-desktop-extension-ai-lab

Work with LLMs on a local environment using containers
https://podman-desktop.io/extensions/ai-lab
Apache License 2.0
182 stars 39 forks source link

fix(LlamaCppPython): nvidia inference server cannot restart #1863

Closed axel7083 closed 1 month ago

axel7083 commented 1 month ago

What does this PR do?

Fix the inference server not restarting on nvidia GPU

Screenshot / video of UI

N/A

What issues does this PR fix or reference?

Fixes https://github.com/containers/podman-desktop-extension-ai-lab/issues/1841

How to test this PR?