Open terfani opened 1 year ago
The same problem on macOs (Intel 2019) Tried to install as 'simple' routine.
Somehow this helped me - I have an Intel-based MacBook 2018. At least it has installed correctly.
CMAKE_ARGS="-DLLAMA_METAL=off -DLLAMA_CLBLAST=on" FORCE_CMAKE=1 pip install -U git+https://github.com/abetlen/llama-cpp-python.git --no-cache-dir
@strelkon Thanks for a try!
Your snippet fulfilled successfully,
but make docker
ends with error:
CMAKE_ARGS="-DLLAMA_METAL=off -DLLAMA_CLBLAST=on" FORCE_CMAKE=1 pip install -U git+https://github.com/abetlen/llama-cpp-python.git --no-cache-dir
This worked for me also.
I'm not 100% what caused the issue, but I was running into problems on my 2018 MacBook Pro (error was not repeatable on my Ubuntu laptop, which installed llama-cpp-python
without issue). Updating and making sure I had the latest version of XCode (v15.0.1) on my laptop, which also required me to update my macOS to 10.13, solved this issue for me and I was able to both cmake
the original llama.cpp
package, and then simply run pip install llama-cpp-python
as well.
My recommendation to debug this issue is try running the cmake commands for llama-cpp
:
git clone git@github.com:ggerganov/llama.cpp.git
cd llama.cpp
mkdir build
cd build
cmake ..
# if previous step does not produce errors
cmake --build . --config Release
This will tell you if it's an issue generally with installing llama-cpp
or if it's an issue with the python package and will help us debug next steps.
Last quick note: When I updated macOS and subsequently XCode, I initially tried to just run the pip install
command, which still failed. Running the the aforementioned commands required me to explicitly accept the xcode license as admin, and after taking all of those steps the pip install command ran smoothly for me.
Hope this helps
I went through all the one on other threads but still get the same error both on installing llama.cpp and llama-cpp-python. I also went through the developer installation also as suggested and also tried remove the verbatim related to Apple as I use macOS (not the M1 but the intel one) but still the same error.
I tried to do the llama.cpp also as suggested on #714 and I get the error: use of undeclared identifier errors?