josephrocca / OpenCharacters

Simple little web interface for creating characters and chatting with them. It's basically a single HTML file - no server. Share characters using a link (character data is stored within the URL itself). All chat data is stored in your browser using IndexedDB. Currently supports OpenAI APIs and ~any Hugging Face model.
https://josephrocca.github.io/OpenCharacters
MIT License
364 stars 60 forks source link

Excess Summarizing #66

Open OwlEnthusiast opened 11 months ago

OwlEnthusiast commented 11 months ago

So this is burning through tokens like crazy, but the AI will write two good paragraphs and then a terrible wrap up paragraph that's something like, "And so, their determined adventure of determination continued, with bright hearts and minds in the city I've already mentioned twice, as the characters all felt deeply and truly about the situation at hand, they all felt a sense of camaraderie."

I try to make sure this isn't happening in any above text so it's not modeling it, but eventually it always starts doing this and I just have my cursor over "stop generating" when it starts to do this.

It still does occasionally write for my character, but I managed to mostly train that out of it with the help of an annoyed reminder message.

Any suggestions? I'm becoming triggered by seeing 'camaraderie' and 'determined' flung so freely, and I delete them whenever they come up. I limited the tokens to 250 per entry as a way to try to keep it short, and that helped at the beginning, but now it's starting to ramble and summarize again.