Wrong llamacpp server image is pulled when starting AI lab app(e.g Summerizer) on GPU enabled podman machine

containers / ai-lab-recipes

Examples for building and running LLM services and applications locally with Podman

Apache License 2.0

111 stars 110 forks source link

Wrong llamacpp server image is pulled when starting AI lab app(e.g Summerizer) on GPU enabled podman machine #710

Closed cbr7 closed 3 months ago

cbr7 commented 3 months ago

Currently if the user tries to install an AI Lab application, like Summerizer, on a GPU enabled podman machine(like libkrun type provider) the llamacpp server image is still the default one, not the GPU enabled one.