[Bug] Adding Custom Endpoint, Azure, Breaks default Google Gemini

[jalkestrup]

Describe the bug Adding a custom endpoint (Azure) breaks the Google Gemini model endpoint.

I have added a GOOGLE_API_KEY to my Vercel deployment. After deployment, the gemini-pro chat works as expected.

If I then add a custom endpoint via the GUI by going to settings, setting up Azure Endpoint, API key, API version and giving the model endpoint a custom name, this new model endpoints work. But now the gemini-pro does not work, and returns "Empty response" after a while. I have attempted to relaunch Vercel app, clear cookies etc., the problem repeats.

To Reproduce Steps to reproduce the behavior:

1. Set GOOGLE_API_KEY in vercel environment, deploy app
2. Check that gemini-pro works in chat UI
3. Go to settings, set up custom endpoint (Azure in this case)
4. Try to chat to gemini-pro in chat UI again, it now fails.

Expected behavior Adding a custom Azure endpoint should not affect the gemini-pro model

Screenshots

Deployment

• [ ] Docker
• [ X ] Vercel
• [ ] Server

Desktop (please complete the following information):

• OS: [e.g. iOS]
• Browser [Chrome]
• Version [Forked and deployed on latest version per 13/2/2024]

Additional Logs Add any logs about the problem here.

[Issues-translate-bot]

Bot detected the issue body's language is not English, translate it automatically.

---

Title: [Bug] Adding Custom Endpoint, Azure, Breaks default Google Gemini

[jalkestrup]

Screenshot of custom endpoint settings in GUI: