Open valentimarco opened 1 year ago
Good catch! Let's wait a little for GGUF to stabilize (I see all GMML models are being converted on huggingface) and update also here
@valentimarco I don't understand if "old" ggml models will still ve compatible or it is a breaking change
It's a breaking change, but they provide a script to convert old format.
New versions of llama-cpp-python needs a
.gguf
that can be created from old format byconvert-llama-ggmlv3-to-gguf.py
script in llama.cpp