Closed orangebutblue closed 1 month ago
The Google Endpoint is specifically designed for Gemini models and utilizes a different API schema compared to Anthropic's models. As a result, Claude models cannot be directly accessed through this endpoint. However, if you wish to use Claude via Google Cloud Vertex AI, you'll need to implement a proxy solution. One option is to use litellm, which acts as an proxy, allowing you to interact with Claude through the Vertex AI infrastructure.
What happened?
Using Vertex AI (for Claude). LibreChat crashes instantly when I send a message. I get redirected to the following error:
When I open that link, it says:
I'm using the docker version. The docker log says:
I don't think it has anything to do with the censor/filter. It does it for every message I'm trying to send.
These are the relevant changes i've made in the .env:
contents of my docker-compose.override.yml:
Of course the file is there:
Steps to Reproduce
What browsers are you seeing the problem on?
Firefox, Chrome
Relevant log output