search

matrixgpt / matrix-chatgpt-bot

Talk to ChatGPT via any Matrix client!
GNU Affero General Public License v3.0
230 stars 64 forks source link

Support streaming responss #252

Closed MuhammadHadiofficial closed 7 months ago

MuhammadHadiofficial commented 7 months ago

Any way to enable streaming response to consume server sent events and show the word by word generation on chat?

tcpipuk commented 7 months ago

I had no idea the OpenAI API returns SSE for streaming responses!

In either case, it'd be incredibly spammy for most servers if the bot posts that many message edits, especially for longer messages... I'd be worried about that being an option, even if it's disabled by default.

bertybuttface commented 7 months ago

Yeah agreed I don't think we have a good solution for this from the Matrix end of things.