search

ggerganov / llama.cpp

LLM inference in C/C++
MIT License
61.24k stars 8.75k forks source link

Bug: brew install on a Mac #8065

Open mneedham opened 1 week ago

mneedham commented 1 week ago

What happened?

I've previous had llama.cpp installed via brew and it worked fine, but somehow today I've broken it. It throws this error:

illegal hardware instruction

My suspicion is that it hasn't been installed for the arm64 architecture somehow.

Name and Version

llama-server --version [1] 19222 illegal hardware instruction llama-cli --version

What operating system are you seeing the problem on?

Mac Sonama 14.4.1

Relevant log output

$ whereis llama-server
llama-server: /usr/local/bin/llama-server

$ file /usr/local/bin/llama-server
/usr/local/bin/llama-server: Mach-O 64-bit executable x86_64

$ llama-server langchain-llamacpp/downloads/MaziyarPanahi_Mistral-7B-Instruct-v0.3-GGUF_f_Q4_K_M/Mistral-7B-Instruct-v0.3.Q4_K_M.gguf
[1]    17507 illegal hardware instruction  llama-server
jmtatsch commented 1 week ago

Just tried this on my m1 MacBookPro and worked flawlessly. MacOS 14.5