ModuleNotFoundError: No module named 'llama_cpp'

[szymonk92]

Running sqlcoder launch I am getting: ModuleNotFoundError: No module named 'llama_cpp'

Python 3.10.13 Env: Conda

EDIT Intel i7 Windows only integrated GPU

[rishsriv]

Hi there, have you followed the setup instructions for Apple Silicon?

CMAKE_ARGS="-DLLAMA_METAL=on" pip install "sqlcoder[llama-cpp]"

[szymonk92]

I am using Intel i7 with Windows

[rishsriv]

Ah, in that case, use the following and you should be good to go!

$env:CMAKE_ARGS = "-DLLAMA_BLAS=ON -DLLAMA_BLAS_VENDOR=OpenBLAS"
pip install "sqlcoder[llama-cpp]"