Nuvotion-Live / Harmony3

1 stars 0 forks source link

Throttle updates, prevent duplicates #13

Closed tom-leamon closed 2 months ago

tom-leamon commented 2 months ago

When streaming responses, especially from groq (500t/s), it can make updates so rapidly that the UI lags, and perhaps pocketbase performance is strained as well. A throttling mechanism should be introduced.

Also, any duplicate updates need to be filtered. This is normally handled by pocketbase but seems like it can still cause issues.