search

cheshire-cat-ai / llama-local

MIT License
6 stars 1 forks source link

Update Readme.md #1

Open valentimarco opened 1 year ago

valentimarco commented 1 year ago

New versions of llama-cpp-python needs a .gguf that can be created from old format by convert-llama-ggmlv3-to-gguf.py script in llama.cpp

pieroit commented 1 year ago

Good catch! Let's wait a little for GGUF to stabilize (I see all GMML models are being converted on huggingface) and update also here

pieroit commented 1 year ago

@valentimarco I don't understand if "old" ggml models will still ve compatible or it is a breaking change

valentimarco commented 1 year ago

It's a breaking change, but they provide a script to convert old format.