search

alexrozanski / LlamaChat

Chat with your favourite LLaMA models in a native macOS app
https://llamachat.app
MIT License
1.43k stars 53 forks source link

Support ggmlv3 #34

Open jingsam opened 1 year ago

jingsam commented 1 year ago

I download llama-7b.ggmlv3.q4_0.bin from https://huggingface.co/TheBloke/LLaMa-7B-GGML/tree/main, LlamaChat says not a valid model. It seems not support ggmlv3 format.

image
alexrozanski commented 1 year ago

LlamaChat v2 is coming with expanded support for ggml and other models. development has stalled for a bit but hopefully I'll be able to get back to it soon 👌🏼

ymcui commented 1 year ago

LlamaChat v2 is coming with expanded support for ggml and other models. development has stalled for a bit but hopefully I'll be able to get back to it soon 👌🏼

@alexrozanski Looking forward to new version. BTW, as a kind reminder, llama.cpp will have breaking changes on its model format (ggjt-v3 to gguf). Maybe it is good to keep an eye on this: https://github.com/ggerganov/llama.cpp/pull/2398