search

googlecodelabs / feedback

Provide feedback to our codelabs by filing an issue here
18 stars 22 forks source link

[how-to-use-ollama-sidecar-open-webui-frontend-cloud-run-gpu]: not working #1441

Open szxyks opened 1 week ago

szxyks commented 1 week ago

Following this link: https://codelabs.developers.google.com/codelabs/how-to-use-ollama-sidecar-open-webui-frontend-cloud-run-gpu#6

I'm getting the below error: $ gcloud beta run services replace service.yaml

Applying new configuration to Cloud Run service [ollama-sidecar-codelab] in project [steeve-playground] region [us-central1]
X  Deploying...                                                                                                                                                                                                                                                              
  -  Creating Revision...                                                                                                                                                                                                                                                    
  .  Routing traffic...                                                                                                                                                                                                                                                      
Deployment failed                                                                                                                                                                                                                                                            
ERROR: (gcloud.beta.run.services.replace) Revision 'ollama-sidecar-codelab-00006-bg8' is not ready and cannot serve traffic. The user-provided container failed to start and listen on the port defined provided by the PORT=8080 environment variable. Logs for this revision might contain more information.

Logs URL: https://console.cloud.google.com/logs/viewer?project=steeve-playground&resource=cloud_run_revision/service_name/ollama-sidecar-codelab/revision_name/ollama-sidecar-codelab-00006-bg8&advancedFilter=resource.type%3D%22cloud_run_revision%22%0Aresource.labels.service_name%3D%22ollama-sidecar-codelab%22%0Aresource.labels.revision_name%3D%22ollama-sidecar-codelab-00006-bg8%22 
For more troubleshooting guidance, see https://cloud.google.com/run/docs/troubleshooting#container-failed-to-start

The provided steps don't work, can someone please look at this and fix it because I ran all the command as outlined in the article

szxyks commented 1 week ago

Not only that I have to fix the following:

In my terminal, here is what was deployed us-central1-docker.pkg.dev/$PROJECT_ID/ollama-sidecar-codelab-repo/ollama-gemma-2b us-central1-docker.pkg.dev/$PROJECT_ID/ollama-sidecar-codelab-repo/openwebui

While in service.yaml file you have us-central1-docker.pkg.dev/$PROJECT_ID/ollama-sidecar-codelab/ollama-gemma-2b us-central1-docker.pkg.dev/$PROJECT_ID/ollama-sidecar-codelab/openwebui

I add to fix so that I can run: $ gcloud beta run services replace service.yaml

Which resulted in: Deployment failed ERROR: (gcloud.beta.run.services.replace) Revision 'ollama-sidecar-codelab-00006-bg8' is not ready and cannot serve traffic. The user-provided container failed to start and listen on the port defined provided by the PORT=8080 environment variable.