search

containers / podman-desktop-extension-ai-lab-playground-images

Apache License 2.0
1 stars 4 forks source link

Gpu not working with llama cpp python server > 0.2.79 #40

Closed lstocchi closed 1 month ago

lstocchi commented 1 month ago

To be verified as I did some tests related to https://github.com/containers/podman-desktop-extension-ai-lab/issues/1479 but i had the impression that the latest vulkan image does not work properly and we have to revert to the python base image 311:1-66.172....

lstocchi commented 1 month ago

After having investigated much the problem was within the llama_cpp python server. By reverting it and keeping the current base image it works fine