search

TabbyML / tabby

Self-hosted AI coding assistant
https://tabby.tabbyml.com/
Other
20.08k stars 914 forks source link

/v1/health check customization for clients #966

Closed jamiemoller closed 7 months ago

jamiemoller commented 7 months ago

The health check that is executed by the (at the least) vscode plugin prevents the use of any other openai api compatible llm endpoints.

The explicit use case I was testing was using the tabby plugin for vscode with my localai endpoint Unfortunately the localai health location is /healthz and returns the plain text OK

I have been unable to find a way to disable this check within the configuration of the client and there is no documentation for this otherwise

Please reply with a 👍 if you want this feature.

wsxiaoys commented 7 months ago

Hey - vscode extension expects the tabby server api protocol, defined in https://tabby.tabbyml.com/api

It's not openai compatible, thus remove /v1/health check itself won't work