feat(option): Custom sampling order

rendezqueue / rendezllama

CLI for llama.cpp with various commands to guide, edit, and regenerate tokens on the fly.

ISC License

10 stars 1 forks source link

feat(option): Custom sampling order #36

Open grencez opened 7 months ago

grencez commented 1 month ago

I'm going to wait for llama.cpp's sampling refactor. It looks like some of the project's CLI is going to be exposed as a library, so the most reliable implementation on our end could just hook into that.