search

danny-avila / LibreChat

Enhanced ChatGPT Clone: Features Anthropic, AWS, OpenAI, Assistants API, Azure, Groq, o1, GPT-4o, Mistral, OpenRouter, Vertex AI, Gemini, Artifacts, AI model switching, message search, langchain, DALL-E-3, ChatGPT Plugins, OpenAI Functions, Secure Multi-User System, Presets, completely open-source for self-hosting. Actively in public development.
https://librechat.ai/
MIT License
17.98k stars 2.99k forks source link

Support gemini through vertex #2255

Closed edge7 closed 6 months ago

edge7 commented 6 months ago

What features would you like to see added?

Hi. I think it is important to allow and support users to use gemini through vertex as the other method (api key) is not available to several countries.

More details

Gemini through the gen ai key is not available in different countries, so gemini should be supported also via vertex.

Which components are impacted by your request?

Endpoints

Pictures

No response

Code of Conduct

danny-avila commented 6 months ago

This is planned. Will slate it before v0.7.1 release

edge7 commented 6 months ago

Ok. In the meantime do you guys have an option to route Google generative requests through a proxy? I need to do it, to modify the country. Also with Google generative api, though Google studio is possibile to use gemini pro 1.5. Is that possible within your repo? Thanks

danny-avila commented 6 months ago

Ok. In the meantime do you guys have an option to route Google generative requests through a proxy? I need to do it, to modify the country. Also with Google generative api, though Google studio is possibile to use gemini pro 1.5. Is that possible within your repo? Thanks

Not yet, on both items. You can try using openrouter to access all latest google models: https://openrouter.ai/

edge7 commented 6 months ago

Ok. Open router ai also does not support pro1.5.

By the way, use it should not be a big deal as hopefully the interface is the same and just the model changes. It would be nice to have it (but together with a proxy, even global proxy or half world would not be able to use it)

Thanks for answering