search

containers / podman-desktop-extension-ai-lab

Work with LLMs on a local environment using containers
https://podman-desktop.io/extensions/ai-lab
Apache License 2.0
170 stars 31 forks source link

Update inference server images to latest llama-cpp-python #1772

Closed jeffmaury closed 4 days ago

lstocchi commented 5 days ago

Be sure to verify gpu works on libkrun -> https://github.com/containers/podman-desktop-extension-ai-lab-playground-images/issues/40