etkecc / baibot

🤖 A Matrix bot for using diffent capabilities (text-generation, text-to-speech, speech-to-text, image-generation, etc.) of AI / Large Language Models (OpenAI, Anthropic, etc.)
GNU Affero General Public License v3.0
15 stars 0 forks source link

Support for text streaming output? #7

Open mwnu opened 3 days ago

mwnu commented 3 days ago

Currently, most AI chatbots use streaming responses for output. It seems that Matrix doesn't have this specification, but the effect of streaming output can be simulated through repeated editing. This is similar to how this Telegram bot works. When this bot is bridged to Matrix, you can also see a pretty good effect: recording