search

danswer-ai / danswer

Gen-AI Chat for Teams - Think ChatGPT if it had access to your team's unique knowledge.
https://docs.danswer.dev/
Other
9.79k stars 1.1k forks source link

Add option to configure custom OpenAI-compatible model via env vars #1605

Open sd109 opened 3 weeks ago

sd109 commented 3 weeks ago

At the moment only 'well known' model providers can be configured automatically via env vars. To configure a custom provider, the admin account must set it up via the UI. This change makes it possible to configure a custom OpenAI compatible model provider (e.g. a HuggingFace model served via vLLM) entirely via the following env vars:

GEN_AI_DISPLAY_NAME: "My custom model name"
GEN_AI_MODEL_PROVIDER: custom
GEN_AI_LLM_PROVIDER_TYPE: openai
GEN_AI_MODEL_VERSION: model-org/model-name
GEN_AI_API_ENDPOINT: http://my-self-hosted-model.com
vercel[bot] commented 3 weeks ago

Someone is attempting to deploy a commit to the Danswer Team on Vercel.

A member of the Team first needs to authorize it.