search

LostRuins / koboldcpp

Run GGUF models easily with a KoboldAI UI. One File. Zero Install.
https://github.com/lostruins/koboldcpp
GNU Affero General Public License v3.0
5.14k stars 353 forks source link

The issue is that koboldcpp is telling a different story. #538

Open kbuwel opened 11 months ago

kbuwel commented 11 months ago

I switched from chatting with koboldcpp to story mode. Although some of the previous content remained in memory, it suddenly started writing a different novel. I registered a profile for the protagonist in the memory and began conversing with the chatbot. It started with introducing itself. Then, in story mode, I began writing a story with the chatbot as the main character. The story was not concluded, but suddenly in Chapter 2, it mentioned "Her First Love." The protagonist changed. After writing the story for a while, it transitioned back to the original protagonist's story. The new content that started didn't connect with what I was writing. The story kept generating endlessly on its own.

LostRuins commented 11 months ago

What model are you using?

kbuwel commented 11 months ago

xwin-mlewd-13b-v0.2.Q8_0.gguf

LostRuins commented 11 months ago

The model should be fine. Try increasing your max context length in the settings

kbuwel commented 11 months ago

I increased the token and text size to the maximum. The problem has not been resolved.

kbuwel commented 11 months ago

When chatting with koboldcpp, assuming the chatbot uses the name Tony and I assume the name Saralynne, I recorded in memory that I am Tony's mother. However, it seems that the application is not working well. It feels like I'm chatting with a virtual Saralynne, not with an AI. When I say, "Tony, have you eaten?" I expect the AI to respond, "I'm watching TV with Saralynne," but it doesn't seem to be applying correctly.

LostRuins commented 11 months ago

I suspect your prompt is not well formatted. Have you tried some of the example scenarios? Take a look at how the prompt is formatted there.