matrixgpt / matrix-chatgpt-bot

Talk to ChatGPT via any Matrix client!
GNU Affero General Public License v3.0
234 stars 63 forks source link

Feature Request: Use Streaming for sending the bots replies #144

Closed randomsnowflake closed 1 year ago

randomsnowflake commented 1 year ago

Like chat.openai.com does - this results in a much better user experience, especially when the bot is sending a long reply.

max298 commented 1 year ago

Is this a feature matrix supports? I don't know the matrix-apis that well, but I've implemented a similar behavior years ago using the slack-api by editing the messages over and over. This resulted in a very buggy client showing incomplete messages and totally messed up the read-recipients.

So in my opinion if the matrix api does not provide anything designed for "streaming-text" we should not "hack" it into the bot.

randomsnowflake commented 1 year ago

You can edit messages in Matrix and thus simulate streaming messages. In my experience using Synapse this makes the server react very sluggish very fast. I don't know about another way to implement streaming.

bertybuttface commented 1 year ago

No good support for this in Matrix, closing.