search

xhedit / quantkit

cli tool to quantize gguf, gptq, awq, hqq and exl2 models
MIT License
61 stars 4 forks source link

Failed to install on macOS Sonoma: Failed building wheel for llama-cpp-python #2

Closed author-brian-mendonca closed 1 month ago

author-brian-mendonca commented 7 months ago

When running pip3 install llm-quantkit, I hit this error:

Failed building wheel for llama-cpp-python

To fix it, I ran sudo xcode-select -s /Applications/Xcode.app/Contents/Developer

then re-ran the pip3 install llm-quantkit command.

Running Python version 3.11.3.

xhedit commented 7 months ago

All references to llama-cpp-python should have been replaced with llama-cpp-conv, but I'll look again. Thanks for including the solution.