search

LostRuins / lite.koboldai.net

A zero dependency web UI for KoboldAI Horde
GNU Affero General Public License v3.0
78 stars 37 forks source link

optimize Enhanced Chat streaming rendering #37

Closed raefu closed 1 year ago

raefu commented 1 year ago

Implemented because I really like the feeling of token-by-token streaming in SillyTavern.

The optimizations were implemented to make this performant on mobile.

(Ignore the first 3 commits from #36)

LostRuins commented 1 year ago

do let me know when this is ready for review

raefu commented 1 year ago

ready for review

raefu commented 1 year ago

(removed SSE because it was cherrypicked in)

LostRuins commented 1 year ago

After cherry picking SSE from https://github.com/LostRuins/lite.koboldai.net/commit/f25ce0e03d2f6d3043c21623213a119e67534748 and adding https://github.com/LostRuins/lite.koboldai.net/commit/bfc08bd35f05cb54b59e4e821d22339d61891045 this PR may not be needed anymore as the gametext Renderer is not used during SSE.

Will reopen if needed. Thanks for your SSE contribution!