search

rendezqueue / rendezllama

CLI for llama.cpp with various commands to guide, edit, and regenerate tokens on the fly.
ISC License
10 stars 1 forks source link

update(llama.cpp): with new GGUF file format #34

Closed grencez closed 11 months ago

grencez commented 1 year ago

I also need to refactor some things first because of how tokenization is changing.

grencez commented 11 months ago

It's on the "update" branch and seems to work well. Need to update docs a bit more before merging. Should be done later tomorrow.