Open erskine opened 11 months ago
Our LLM clients should interact with all the models we host in an OpenAI compatible API format.
Find/download/write a service to route inbound requests to the appropriate model (OpenAI, Databricks-hosted models, others, etc)
Preferred to be serverless
Our LLM clients should interact with all the models we host in an OpenAI compatible API format.
Find/download/write a service to route inbound requests to the appropriate model (OpenAI, Databricks-hosted models, others, etc)
Preferred to be serverless