Stop Generation Button

[richardstevenhack]

Some of these models get very wordy and if you can see that they're off on a tangent, it's valuable to have a "Stop Generation" button that tells them to stop streaming their response. MSTY and some other LLM frontends have this feature. So I'm suggesting this as an enhancement to SystemSculpt.

[josh-stephens]

A button that you could toggle down in the Status bar next to max tokens and "C" "T" and "R" would be a good option to have, but just FYI there's a command to stop generation that you can reach with the command palette (ctrl-p+start typing "stop" until you see "SystemSculpt AI: Stop all generation processes"+Enter) or a keyboard shortcut (I made it ctrl-s since Obsidian saves as you type).

However, I tested the command and unfortunately it often does not work for me during a generation so hopefully Mike can take a look at that as well.

[richardstevenhack]

Thanks, I'll try that the next time. As for the placement of the button, though, I think in the bottom of the chat box would be best. Looks like a lot of empty space under the message box,even allowing for expansion of that for long prompts.

[SystemSculpt]

Both of you are correct; currently, the Stop Generation command is still an early version, it only works on General Generations, and even then seems to be buggy. Though I am working on a fix that will be present in tomorrow's or next week's update depending on how confident I am about it. I'll keep this open until it's fixed.