search

LostRuins / koboldcpp

Run GGUF models easily with a KoboldAI UI. One File. Zero Install.
https://github.com/lostruins/koboldcpp
GNU Affero General Public License v3.0
5.35k stars 364 forks source link

More rewind on anti-slop if there are no available continuations #1234

Open envy-ai opened 4 days ago

envy-ai commented 4 days ago

Here's my ban list

"eyes glint"
"eyes full"
"eyes gleam"
"eyes sparkl"
"eyes twinkl"
"eyes shin"
"eyes glow"
"eye glint"
"eye full"
"eye gleam"
"eye sparkl"
"eye twinkl"
"eye shin"
"eye glow"

At one point, the model got stuck at "her emerald eyes", and apparently couldn't think of anything other than glinting with mischief, but since all of those phrases were banned, it just stopped generating, no matter how many times I retried, turned the temperature up, adjusted the parameters, and so on. It would be nice to be able to configure how far it can walk back until it's able to generate something.

LostRuins commented 3 days ago

It'll always rewind to the start of the banned phrase. So you might want to ban "her emerald eyes glint" instead, and it will rewind all the way to "her"