Open DarkSRKI24 opened 1 week ago
here is a link to the settings for the launcher. the name of the file is the model I'm using
I don't understand what is happening does the context limit fill up and that's it you can't interact anymore? is there a way to empty out the oldest part of the context and gradually keep replacing it with the new one?
Try using --contextsize 8192
Doesn't matter what the model, it keeps happening. After 20 or so messages the model starts outputting nothing or "::::::::::::::::::". I updated both KoboldCpp and SillyTavern to the latest version but it keeps happening. I am not that tech-savvy so any guess is as good as mine