Feature Request: Streaming support

microsoft / azurechat

🤖 💼 Azure Chat Solution Accelerator powered by Azure Open AI Service

MIT License

1.2k stars 1.12k forks source link

Open FabianGoettl opened 11 months ago

FabianGoettl commented 11 months ago

Hello, I suggest adding:

Streaming response generation for real-time feedback (some larger responses take upto 1min to load)
Blinking cursor at the end to indicate ongoing processing.

These enhancements could improve user engagement and clarity during response generation.

Thanks, Fabian