search

FlowiseAI / Flowise

Drag & drop UI to build your customized LLM flow
https://flowiseai.com
Apache License 2.0
30.21k stars 15.61k forks source link

ChatGoogleVertexAI - Streaming doesn't work for Gemini Models #2994

Open vijaykammili opened 1 month ago

vijaykammili commented 1 month ago

@HenryHengZJ - It looks like Streaming doesn't work for Gemini Models for ChatGoogleVertexAI node. ChatOpenAI, AzureChatOpenAI and ChatAnthropic, all of them return a stream of tokens in the websocket but not Gemini models. It just returns a JSON response.

image
haimco50 commented 1 month ago

Yep - noticed this long time ago but forgot to report - @HenryHengZJ - it would be great to fix this