search

li-plus / chatglm.cpp

C++ implementation of ChatGLM-6B & ChatGLM2-6B & ChatGLM3 & GLM4
MIT License
2.81k stars 326 forks source link

mac m1 pro 16G运行glm4-ggml报错 #329

Open lwo2002 opened 1 week ago

lwo2002 commented 1 week ago

ggml_metal_init: allocating ggml_metal_init: found device: Apple M1 Pro ggml_metal_init: picking default device: Apple M1 Pro ggml_metal_init: default.metallib not found, loading from source ggml_metal_init: GGML_METAL_PATH_RESOURCES = nil ggml_metal_init: loading '/Users/lwo2002/miniforge3/envs/glm/lib/python3.10/site-packages/chatglm_cpp/ggml-metal.metal' ggml_metal_init: error: Error Domain=MTLLibraryErrorDomain Code=3 "program_source:3:10: fatal error: 'ggml-common.h' file not found

include "ggml-common.h"

     ^~~~~~~~~~~~~~~

" UserInfo={NSLocalizedDescription=program_source:3:10: fatal error: 'ggml-common.h' file not found

include "ggml-common.h"

mac m1 pro 16G 运行web_demo,模型glm4-ggml报错，请各位大神，指导， 运行python3 cli_demo.py 无问题。

lwo2002 commented 1 week ago

已自行解决，如有此问题的同学可借鉴： 1、卸载chatglm-cpp 2、使用如下命令： CMAKE_ARGS="-DGGML_METAL_EMBED_LIBRARY=ON -DGGML_METAL=on" pip install -U chatglm-cpp --no-cache-dir 问题解决。