containers / podman-desktop-extension-ai-lab

Work with LLMs on a local environment using containers
https://podman-desktop.io/extensions/ai-lab
Apache License 2.0
151 stars 23 forks source link

Unable to build llamacpp-server #923

Closed cedricclyburn closed 2 months ago

cedricclyburn commented 2 months ago

Hi folks!

I'm using the Summarizer demo recipe but am unable to get things started. It looks like I have no trouble downloading the source code and model, but unfortunately, I can't get the llamacpp server started. This is on Apple Silicon, Sonoma 14.4.1, Podman Desktop v1.9.1 with Podman 5.0.2, this error also happened on my Podman 4.9.2 that I originally had before updating.

Getting this error: no image found for llamacpp-server:latest

Screenshot 2024-04-17 at 10 41 15 PM Screenshot 2024-04-17 at 10 41 46 PM

Logs:

main ↪️ [ai-lab] Reading configuration from /Users/cedric/.local/share/containers/podman-desktop/extensions-storage/redhat.ai-lab/summarizer/summarizer-langchain/ai-lab.yaml.
main ↪️ [ai-lab] There is no workers compatible. Using default local mounting
main ↪️ [ai-lab] Application Manager using context /Users/cedric/.local/share/containers/podman-desktop/extensions-storage/redhat.ai-lab/summarizer/playground for container llamacpp-server
main ↪️ [ai-lab] Application Manager using context /Users/cedric/.local/share/containers/podman-desktop/extensions-storage/redhat.ai-lab/summarizer/summarizer-langchain for container streamlit-summary-app
cedricclyburn commented 2 months ago

Full logs:

warn : MaxListenersExceededWarning: Possible EventEmitter memory leak detected. 11 extensions-started listeners added. Use emitter.setMaxListeners() to increase limit warn : MaxListenersExceededWarning: Possible EventEmitter memory leak detected. 11 extension-started listeners added. Use emitter.setMaxListeners() to increase limit warn : MaxListenersExceededWarning: Possible EventEmitter memory leak detected. 11 extension-stopped listeners added. Use emitter.setMaxListeners() to increase limit log : main ↪️ PluginSystem: received dom-ready event from the UI log : main ↪️ Starting http server to handle webviews on port 44000 log : main ↪️ Error while fetching API groups: Error: No active cluster! log : main ↪️ Error while fetching API groups: Error: No active cluster! log : main ↪️ Delayed startup, flushing 10 events log : main ↪️ System ready. Loading extensions... debug : main ↪️ skip watching deployments in context dev-sandbox-context-devnexus, as the context is not reachable debug : main ↪️ skip watching services in context dev-sandbox-context-devnexus, as the context is not reachable debug : main ↪️ skip watching ingresses in context dev-sandbox-context-devnexus, as the context is not reachable debug : main ↪️ skip watching routes in context dev-sandbox-context-devnexus, as the context is not reachable log : main ↪️ Activating extension (podman-desktop.compose) with max activation time of 10 seconds log : main ↪️ Activating extension (podman-desktop.docker) with max activation time of 10 seconds log : main ↪️ Activating extension (podman-desktop.kind) with max activation time of 10 seconds log : main ↪️ Activating extension (podman-desktop.kube-context) with max activation time of 10 seconds log : main ↪️ [kube-context] starting extension kube-context log : main ↪️ Activating extension (podman-desktop.kubectl-cli) with max activation time of 10 seconds log : main ↪️ Activating extension (podman-desktop.lima) with max activation time of 10 seconds debug : main ↪️ [lima] Could not find socket at /Users/cedric/.lima/podman/sock/podman.sock log : main ↪️ Activating extension (podman-desktop.podman) with max activation time of 10 seconds log : main ↪️ Activating extension (podman-desktop.registries) with max activation time of 10 seconds log : main ↪️ Activating extension (redhat.ai-lab) with max activation time of 10 seconds log : main ↪️ [ai-lab] starting AI Lab extension log : main ↪️ Activating extension (podman-desktop.minikube) with max activation time of 10 seconds log : main ↪️ Activating extension (redhat.redhat-sandbox) with max activation time of 10 seconds log : main ↪️ [redhat-sandbox] starting extension openshift-sandbox log : main ↪️ [redhat-sandbox] Configfile location /Users/cedric/.kube/config log : main ↪️ Activating extension (redhat.podman-desktop-demo) with max activation time of 10 seconds log : main ↪️ [podman-desktop-demo] starting extension podman desktop demo log : main ↪️ Activating extension (podman-desktop.docker) ended in 1087 milliseconds log : main ↪️ Activating extension (podman-desktop.lima) ended in 1042 milliseconds log : main ↪️ Activating extension (podman-desktop.registries) ended in 1029 milliseconds log : main ↪️ Activating extension (redhat.redhat-sandbox) ended in 27 milliseconds log : main ↪️ Activating extension (redhat.podman-desktop-demo) ended in 20 milliseconds log : main ↪️ Activating extension (podman-desktop.compose) ended in 1116 milliseconds error : main ↪️ Unable to fetch the available extensions: Timeout awaiting 'lookup' for 1000ms error : main ↪️ [compose] Error getting compose version: Error: Failed to execute command: spawn /Users/cedric/.local/share/containers/podman-desktop/extensions-storage/podman-desktop.compose/bin/docker-compose ENOENT log : main ↪️ [kind] kind extension is active log : main ↪️ Activating extension (podman-desktop.kind) ended in 1262 milliseconds log : main ↪️ Activating extension (podman-desktop.kubectl-cli) ended in 1246 milliseconds log : main ↪️ [kind] kind extension is active log : main ↪️ [kind] kind extension is active log : main ↪️ [minikube] minikube extension is active log : main ↪️ Activating extension (podman-desktop.minikube) ended in 561 milliseconds log : main ↪️ Activating extension (podman-desktop.kube-context) ended in 1285 milliseconds log : main ↪️ [ai-lab] updated indexHtml to Podman Desktop
log : main ↪️ Activating extension (redhat.ai-lab) ended in 649 milliseconds log : main ↪️ [kind] kind extension is active log : main ↪️ [minikube] minikube extension is active log : main ↪️ [kind] kind extension is active log : main ↪️ [minikube] minikube extension is active log : main ↪️ [kind] kind extension is active log : main ↪️ [minikube] minikube extension is active log : main ↪️ [kind] kind extension is active log : main ↪️ [minikube] minikube extension is active log : main ↪️ Fetched https://registry.podman-desktop.io/api/extensions.json in 288.5595420598984ms warn : main ↪️ [podman] Can't get machine podman-machine-default resource usage error Error: no engine matching this container log : main ↪️ Activating extension (podman-desktop.podman) ended in 1431 milliseconds log : main ↪️ PluginSystem: initialization done. log : main ↪️ Autostarting podman-desktop.podman container engine log : main ↪️ [podman] Podman extension: Do not start a machine as there is already one starting or started log : main ↪️ [kind] kind extension is active log : main ↪️ [minikube] minikube extension is active log : main ↪️ Fetched https://registry.podman-desktop.io/api/extensions.json in 43.16100001335144ms log : main ↪️ Skipping update for extension redhat.ai-lab because installed version 0.4.0 is greater or equal to latest available version 0.4.0 log : main ↪️ Skipping update for extension podman-desktop.minikube because installed version 0.3.0-next is greater or equal to latest available version 0.2.0 log : main ↪️ Skipping update for extension redhat.redhat-sandbox because installed version 0.0.2 is greater or equal to latest available version 0.0.2 log : main ↪️ Skipping update for extension redhat.podman-desktop-demo because it is not available in the registry log : main ↪️ [ai-lab] Reading configuration from /Users/cedric/.local/share/containers/podman-desktop/extensions-storage/redhat.ai-lab/summarizer/summarizer-langchain/ai-lab.yaml. warn : main ↪️ [ai-lab] There is no workers compatible. Using default local mounting log : main ↪️ [ai-lab] Application Manager using context /Users/cedric/.local/share/containers/podman-desktop/extensions-storage/redhat.ai-lab/summarizer/playground for container llamacpp-server log : main ↪️ [ai-lab] Application Manager using context /Users/cedric/.local/share/containers/podman-desktop/extensions-storage/redhat.ai-lab/summarizer/summarizer-langchain for container streamlit-summary-app error : main ↪️ [ai-lab] Something went wrong while building the image: building at STEP "RUN pip install --no-cache-dir --upgrade -r /locallm/requirements.txt": while running runtime: exit status 1 log : main ↪️ event is [object Object] error : main ↪️ [ai-lab] Something went wrong while trying to start application Error: no image found for llamacpp-server:latest log : main ↪️ event is [object Object]
vrothberg commented 2 months ago

Thanks for reaching out!

I cannot reproduce on my end. @benoitf @jeffmaury can you?

jeffmaury commented 2 months ago

Thanks for reaching out!

I cannot reproduce on my end. @benoitf @jeffmaury can you?

May check but busy on 1.0.0 and this will be fixed by 1.0.0

axel7083 commented 2 months ago

The interesting line in the logs is the following

Something went wrong while building the image: building at STEP "RUN pip install --no-cache-dir --upgrade -r /locallm/requirements.txt": while running runtime: exit status 1

We seems not to be catching the right error, linked issue https://github.com/containers/podman-desktop-extension-ai-lab/issues/741