Editting Entries During Generation Breaks Generation

KoboldAI / KoboldAI-Client

For GGUF support, see KoboldCPP: https://github.com/LostRuins/koboldcpp

https://koboldai.com

GNU Affero General Public License v3.0

3.47k stars 747 forks source link

Editting Entries During Generation Breaks Generation #294

Open dreemur99 opened 1 year ago

dreemur99 commented 1 year ago

If you try to change the contents of actions/entries (at least the last one) during text generation, text generation will cease and the formatting process that stiches the tokens together breaks, leaving a line after line of individual tokens rather than consolidating them.

(This is the 4-bit experimental UI version.)

Death-777 commented 1 year ago

I have the same problem. Quite a few times now it has happened and the chat bot will simply repeat the same things it has said or only one phrase and that is it. Completely breaking any character and with no way to fix it seemingly, they just become unusable.