search

microsoft / semantic-kernel

Integrate cutting-edge LLM technology quickly and easily into your apps
https://aka.ms/semantic-kernel
MIT License
21.51k stars 3.17k forks source link

.Net Agents: Add streaming to agent framework #4833

Closed SergeyMenshykh closed 3 weeks ago

SergeyMenshykh commented 8 months ago

Add streaming to the agents abstraction and agenty classes.

Agent streaming is quite a bit different from chat-completion streaming. This is a task with some complexity, risk, and will require some time.

Ultimately, the streaming abstraction must be adaptable across all agent types. This will require some preliminary analysis before coding.

crickman commented 6 months ago

Agent streaming is quite a bit different from chat-completion streaming. This is a task with some complexity, risk, and will require some time (around a week).

Mano1192 commented 3 months ago

Really looking forward to this as well as the agent changes in general. We have a product that we are refactoring to this Agent framework and this is a blocker to releasing.