search

LostRuins / koboldcpp

Run GGUF models easily with a KoboldAI UI. One File. Zero Install.
https://github.com/lostruins/koboldcpp
GNU Affero General Public License v3.0
5.35k stars 364 forks source link

Health endpoint not working in runpod image #1114

Open Immortalin opened 2 months ago

Immortalin commented 2 months ago

Describe the Issue The /health endpoint does not work in runpod

Additional Information: The following error is shown:

Error: HTTP Server is running, but this endpoint does not exist. Please check the URL.
LostRuins commented 2 months ago

Why would this endpoint exist? Where did you get it from?

If you want to get status, use /api/extra/perf/

/api provides documentation on available endpoints.

Immortalin commented 2 months ago

I was looking at this https://github.com/LostRuins/koboldcpp/tree/concedo/examples/server#get-health-returns-heath-check-result

LostRuins commented 2 months ago

Apologies, that document is incorrect. I will remove it. Please refer to this instead. https://lite.koboldai.net/koboldcpp_api