fatal error: 'ggml-common.h' file not found

[guod]

System: Apple M2 Max, Sonoma v14.1.1

What I did: CMAKE_ARGS="-DLLAMA_METAL=on" pip install "sqlcoder[llama-cpp]" sqlcoder launch

Error: ggml_metal_init: error: Error Domain=MTLLibraryErrorDomain Code=3 "program_source:3:10: fatal error: 'ggml-common.h' file not found

include "ggml-common.h"

     ^~~~~~~~~~~~~~~

" UserInfo={NSLocalizedDescription=program_source:3:10: fatal error: 'ggml-common.h' file not found

include "ggml-common.h"

     ^~~~~~~~~~~~~~~

} llama_new_context_with_model: failed to initialize Metal backend

[rishsriv]

Thanks for reporting this! Looking into this and will fix soon. llama.cpp recently had a new release, so I suspect we'll have to update our install instructions

[github-actions[bot]]

This issue is stale because it has been open for 30 days with no activity.

[github-actions[bot]]

This issue was closed because it has been inactive for 14 days since being marked as stale.