Open garrettmaring opened 2 months ago
i've used gemini on some of my other projects, and their models sometimes return the streaming data with an incomplete json, which will cause an error when you try to parse it, I don't know if this is the problem here but just some info for the owners to consider.
This is what I mean, example of incomplete json streaming response data:
{"text": "...", "candidatesTokenCou
They could just leave it like that, it sucks but it's what it is, until they fix it what I'm doing in my projects is to parse what's inside the "text" with a regex 🫨
streaming seems to halt after the first chunk when using the 'gemini' provider (claude working great)