search

rendezqueue / rendezllama

CLI for llama.cpp with various commands to guide, edit, and regenerate tokens on the fly.
ISC License
11 stars 1 forks source link

update(llama.cpp): with new GGUF file format #34

Closed grencez closed 1 year ago

grencez commented 1 year ago

I also need to refactor some things first because of how tokenization is changing.

grencez commented 1 year ago

It's on the "update" branch and seems to work well. Need to update docs a bit more before merging. Should be done later tomorrow.