search

rendezqueue / rendezllama

CLI for llama.cpp with various commands to guide, edit, and regenerate tokens on the fly.
ISC License
10 stars 1 forks source link

feat(option): to skip some antiprompts #10

Closed grencez closed 1 year ago

grencez commented 1 year ago

Too many enters is no fun. We could autocontinue for maybe 3 antiprompts by default, resetting sequent_token_count each time.

It might be interesting to include newline too. We'd want to stop if the line starts with the protagonist name or some unrecognized prefix. That way, characters that think could seamlessly use multiple lines.

grencez commented 1 year ago

sequent_continue_limit seems like a good enough name.

For simplicity, I'm going to use newline as a stopping condition.