Open kbuwel opened 11 months ago
What model are you using?
xwin-mlewd-13b-v0.2.Q8_0.gguf
The model should be fine. Try increasing your max context length in the settings
I increased the token and text size to the maximum. The problem has not been resolved.
When chatting with koboldcpp, assuming the chatbot uses the name Tony and I assume the name Saralynne, I recorded in memory that I am Tony's mother. However, it seems that the application is not working well. It feels like I'm chatting with a virtual Saralynne, not with an AI. When I say, "Tony, have you eaten?" I expect the AI to respond, "I'm watching TV with Saralynne," but it doesn't seem to be applying correctly.
I suspect your prompt is not well formatted. Have you tried some of the example scenarios? Take a look at how the prompt is formatted there.
I switched from chatting with koboldcpp to story mode. Although some of the previous content remained in memory, it suddenly started writing a different novel. I registered a profile for the protagonist in the memory and began conversing with the chatbot. It started with introducing itself. Then, in story mode, I began writing a story with the chatbot as the main character. The story was not concluded, but suddenly in Chapter 2, it mentioned "Her First Love." The protagonist changed. After writing the story for a while, it transitioned back to the original protagonist's story. The new content that started didn't connect with what I was writing. The story kept generating endlessly on its own.