[Feature Request] Make text selectable during generation.

LostRuins / koboldcpp

A simple one-file way to run various GGML and GGUF models with a KoboldAI UI

https://github.com/lostruins/koboldcpp

GNU Affero General Public License v3.0

4.41k stars 319 forks source link

[Feature Request] Make text selectable during generation. #759

Open openMolNike opened 3 months ago

openMolNike commented 3 months ago

Make text selectable during generation.

English is not my native language. Sometimes I want to copy a word to paste into the translation tool, but while the text generation continues, I cannot select new text, the selection is constantly reset.

aleksusklim commented 3 months ago

Not sure how this would be fixed given the nature of progressive HTML rendering, but this is how you can cope with it:

Quickly Ctrl+A and Ctrl+C, then paste into the Notepad and grab the word you need.
With enabled SSE streaming – just Abort the generation whenever you need to copy something. Then continue Generate More, it should not give you any errors or slowdowns!

LostRuins commented 3 months ago

Yep, what @aleksusklim said. The incoming streaming text (yellow text) is constantly refreshed so keeping it selected won't work. But the old (white text) should be selectable. Otherwise, you can consider changing the streaming mode.