search

Azure / azure-sdk-for-go

This repository is for active development of the Azure SDK for Go. For consumers of the SDK we recommend visiting our public developer docs at:
https://docs.microsoft.com/azure/developer/go/
MIT License
1.63k stars 836 forks source link

[azopenaiassistants] Streaming Support #22857

Closed pkrauss-prot closed 3 months ago

pkrauss-prot commented 5 months ago

Feature Request

This could very well need changes from the Service API also. However, if the Service API already supports Streaming, can we add support for streaming assistant messages. I'am sure this does not need explaining but given the computation heavy prompts its nice to stream results as they come, rather than waiting the entire round trip. While the interfaces are not exactly the same, I believe the Service API layer is similar to support parity with the releases on Openai's side given the partnership.

https://community.openai.com/t/streaming-is-now-available-in-the-assistants-api/682011

If or when this feature is added it would be great to include in the examples and documentation regarding working streaming into common existing workflows like tools and such.

github-actions[bot] commented 5 months ago

Thank you for your feedback. Tagging and routing to the team member best able to assist.

richardpark-msft commented 3 months ago

@pkrauss-prot, this has come out in the latest azopenaiassistants package. Here's an example if you want to quickly get started: https://pkg.go.dev/github.com/Azure/azure-sdk-for-go/sdk/ai/azopenaiassistants#example-package-AssistantsStreaming