feat(chat command): to forget/expire older lines from the rolling prompt

rendezqueue / rendezllama

CLI for llama.cpp with various commands to guide, edit, and regenerate tokens on the fly.

ISC License

10 stars 1 forks source link

feat(chat command): to forget/expire older lines from the rolling prompt #7

Closed grencez closed 1 year ago

grencez commented 1 year ago

Chat dialogue can start looping, and it's hard to get out of that state. In theory, we should be able to fix this by removing some dialogue from the context. This should force the priming prompt to have more meaning.