search

danswer-ai / danswer

Gen-AI Chat for Teams - Think ChatGPT if it had access to your team's unique knowledge.
https://danswer.ai
Other
10.58k stars 1.32k forks source link

Gemini Setup #2325

Open PhieuDieuVoCuc opened 2 months ago

PhieuDieuVoCuc commented 2 months ago

I want to use Danswer with Gemini. In the setup Setup Custom LLM Provider section, I configured it as follows: Provider name: gemini API Key: xxx API Base: https://generativelanguage.googleapis.com/ Model Names: gemini/gemini-pro But I'm encountering an error: "400: litellm.NotFoundError: VertexAIException -" Some log files are as follows: INFO: h11_impl.py 499: 172.18.0.9:59016 - "GET /manage/admin/user-group HTTP/1.1" 404 WARNING: utils.py 325: Failed to call LLM with the following error: litellm.NotFoundError: VertexAIException - WARNING: utils.py 325: Failed to call LLM with the following error: litellm.NotFoundError: VertexAIException - ERROR: main.py 413: 400: litellm.NotFoundError: VertexAIException -

tim-dim commented 1 month ago

Might be a litellm issue: https://github.com/BerriAI/litellm/issues/5798