search

virtUOS / kiwi

A simple and configurable portal to proxy to llms.
https://virtuos.github.io/kiwi/
GNU Affero General Public License v3.0
2 stars 3 forks source link

Avoid flickering updates in the prompts #14

Closed tibroc closed 6 months ago

tibroc commented 7 months ago

The flickering of the response updates is caused by the stream being updated. We need to save the previous streamed messages locally in a variable and append to the locally saved messages.

Odrec commented 7 months ago

All the solutions we have tried here are worse than the current state so I would suggest to release it like this until we find a better solution since the issue doesn't break the app and it's just a bit annoying.