search

li-plus / chatglm.cpp

C++ implementation of ChatGLM-6B & ChatGLM2-6B & ChatGLM3 & GLM4
MIT License
2.81k stars 327 forks source link

hf上下载的gguf量化后的模型文件，运行报错 #324

Closed vaxilicaihouxian closed 1 week ago

vaxilicaihouxian commented 1 week ago 
(base) machenchi@MacBook-Pro chatglm.cpp % ./build/bin/main -m /Users/machenchi/Downloads/glm-4-9b-chat.Q4_K_S.gguf -p hello
/Users/machenchi/github/chatglm.cpp/chatglm.cpp:1769 check failed (magic == "ggml") model file is broken (bad magic)
li-plus commented 1 week ago

目前不兼容 llama.cpp 转出来的 gguf 格式