search

danny-avila / LibreChat

Enhanced ChatGPT Clone: Features Anthropic, AWS, OpenAI, Assistants API, Azure, Groq, o1, GPT-4o, Mistral, OpenRouter, Vertex AI, Gemini, Artifacts, AI model switching, message search, langchain, DALL-E-3, ChatGPT Plugins, OpenAI Functions, Secure Multi-User System, Presets, completely open-source for self-hosting. Actively in public development.
https://librechat.ai/
MIT License
17.86k stars 2.96k forks source link

[Bug]: Gemini seems to have a fake streaming expreience #3217

Closed hjkcai closed 3 months ago

hjkcai commented 3 months ago

What happened?

When streaming of Gemini is enabled, the response seems to be returned in a constant speed. I have verified this through a self-written gemini proxy server. LibreChat always waits for the complete response from gemini then send to the user.

How to make it return the response in real-time? I can help submit a PR if I know how.

Steps to Reproduce

Just use Gemini

What browsers are you seeing the problem on?

Chrome

Relevant log output

No response

Screenshots

No response

Code of Conduct