Is your feature request related to a problem? Please describe.
I saw the current implementation of Groq and Mistral Client doesn't print chunk to IOStream when in stream mode. And I observed that in Gemini and Together Client there are comments to describe why they can't be stream or will do in the future. I wonder is there something blocking print chunk to IOStream in Groq or Mistral Client, or just missing the implementation?
For myself, I manually add logic to print chunk to IOStream for GroqClient and it seems works well, with groq == 0.9.0, maybe we can also add the logic to MistralClient ?
Is your feature request related to a problem? Please describe.
I saw the current implementation of Groq and Mistral Client doesn't print chunk to IOStream when in stream mode. And I observed that in Gemini and Together Client there are comments to describe why they can't be stream or will do in the future. I wonder is there something blocking print chunk to IOStream in Groq or Mistral Client, or just missing the implementation?
For myself, I manually add logic to print chunk to IOStream for GroqClient and it seems works well, with
groq == 0.9.0, maybe we can also add the logic to MistralClient ?Describe the solution you'd like
No response
Additional context
No response