search

chenhunghan / ialacol

🪶 Lightweight OpenAI drop-in replacement for Kubernetes
MIT License
143 stars 17 forks source link

Deployment fails to respond with errors #57

Closed DavidARivkin closed 1 year ago

DavidARivkin commented 1 year ago

I have been able to deploy this to Okteto and the Volume has been created and the pod successfully loads a model. However, when I port-forward into it, which kubectl says worked, and I connect to localhost:8000, I only get "{"detail":"Not Found"}" in my browser and log for the pod is as follows: 2023-08-24 17:14:36.55 UTCllamacpp-64bdc45bc5-fk6h9llamacppINFO: Application startup complete. 2023-08-24 17:14:36.55 UTCllamacpp-64bdc45bc5-fk6h9llamacppINFO: Uvicorn running on http://0.0.0.0:8000/ (Press CTRL+C to quit) 2023-08-24 17:15:28.35 UTCllamacpp-64bdc45bc5-fk6h9llamacppINFO: 10.8.26.12:32790 - "GET / HTTP/1.1" 404 Not Found 2023-08-24 17:19:14.65 UTCllamacpp-64bdc45bc5-fk6h9llamacppINFO: 127.0.0.1:58060 - "GET / HTTP/1.1" 404 Not Found 2023-08-24 17:19:14.91 UTCllamacpp-64bdc45bc5-fk6h9llamacppINFO: 127.0.0.1:58060 - "GET /favicon.ico HTTP/1.1" 404 Not Found 2023-08-24 17:19:21.12 UTCllamacpp-64bdc45bc5-fk6h9llamacppINFO: 127.0.0.1:58064 - "GET / HTTP/1.1" 404 Not Found 2023-08-24 17:19:22.11 UTCllamacpp-64bdc45bc5-fk6h9llamacppINFO: 127.0.0.1:58064 - "GET / HTTP/1.1" 404 Not Found 2023-08-24 17:42:47.20 UTCllamacpp-64bdc45bc5-fk6h9llamacppINFO: 127.0.0.1:58222 - "GET / HTTP/1.1" 404 Not Found

How can I fix this or is this a known bug in the Image as it seems like the webserver is misconfigured.

chenhunghan commented 1 year ago

Hello! Seems like you are expecting some browser UI? ialacol don't have UI but only OpenAI RESTful APIs.