feat(option): to restrict the grammar

rendezqueue / rendezllama

CLI for llama.cpp with various commands to guide, edit, and regenerate tokens on the fly.

ISC License

11 stars 1 forks source link

feat(option): to restrict the grammar #27

Open grencez opened 1 year ago

grencez commented 1 year ago

A parsing expression grammar might be possible. We'd have to track a frontier, so it's best to forbid recursion in the first position.

[ ] https://github.com/rendezqueue/rendezllama/issues/36 - Wait for sampling refactor.
[ ] Implement.

grencez commented 1 year ago

Grammar restrictions should apply to individual lines of character dialogue because we impose a chatbot format, which is kinda fundamental to the project.

grencez commented 1 year ago

llama.cpp has grammar restrictions now. It's probably better than anything I could do initially. Will give it a look.

Need to get better sxpb parsing first so the grammar can be configured! It's in flight.