Closed pkrauss-prot closed 3 months ago
Thank you for your feedback. Tagging and routing to the team member best able to assist.
@pkrauss-prot, this has come out in the latest azopenaiassistants package. Here's an example if you want to quickly get started: https://pkg.go.dev/github.com/Azure/azure-sdk-for-go/sdk/ai/azopenaiassistants#example-package-AssistantsStreaming
Feature Request
This could very well need changes from the Service API also. However, if the Service API already supports Streaming, can we add support for streaming assistant messages. I'am sure this does not need explaining but given the computation heavy prompts its nice to stream results as they come, rather than waiting the entire round trip. While the interfaces are not exactly the same, I believe the Service API layer is similar to support parity with the releases on Openai's side given the partnership.
https://community.openai.com/t/streaming-is-now-available-in-the-assistants-api/682011
If or when this feature is added it would be great to include in the examples and documentation regarding working streaming into common existing workflows like tools and such.