Is your feature request related to a problem? Please describe.
Similar to this ticket, the VertexAIGeminiChatGenerator does have streaming_callback implementation, even though the underlying GenerativeModel does support stream=Truehttps://github.com/deepset-ai/haystack/issues/7836
Is your feature request related to a problem? Please describe. Similar to this ticket, the VertexAIGeminiChatGenerator does have streaming_callback implementation, even though the underlying
GenerativeModel
does supportstream=True
https://github.com/deepset-ai/haystack/issues/7836The underlying model supports an iterable chat response https://github.com/googleapis/python-aiplatform/blob/main/vertexai/generative_models/_generative_models.py#L522
Describe the solution you'd like Similar to this https://github.com/deepset-ai/haystack/pull/8054, by @Amnah199 :)