Installing llama-cpp-python with GPU Support

[utterances-bot]

Installing llama-cpp-python with GPU Support

https://michaelriedl.com/2023/09/10/llama2-install-gpu.html

[Dmitry-cybe]

Thank you very much, I did as you said, but it still doesn’t work(

× Building wheel for llama-cpp-python (pyproject.toml) did not run successfully. │ exit code: 1 ╰─> [20 lines of output] scikit-build-core 0.8.0 using CMake 3.28.1 (wheel) Configuring CMake... 2024-02-01 21:38:37,952 - scikit_build_core - WARNING - Can't find a Python library, got libdir=None, ldlibrary=None, multiarch=None, masd=None loading initial cache file C:\Users\zhabr\AppData\Local\Temp\tmp7pwy5_a6\build\CMakeInit.txt -- Building for: NMake Makefiles CMake Error at CMakeLists.txt:3 (project): Running

     'nmake' '-?'

    failed with:

     no such file or directory

  CMake Error: CMAKE_C_COMPILER not set, after EnableLanguage
  CMake Error: CMAKE_CXX_COMPILER not set, after EnableLanguage
  -- Configuring incomplete, errors occurred!

  *** CMake configuration failed
  [end of output]

note: This error originates from a subprocess, and is likely not a problem with pip. ERROR: Failed building wheel for llama-cpp-python Failed to build llama-cpp-python ERROR: Could not build wheels for llama-cpp-python, which is required to install pyproject.toml-based projects Can you tell me what's wrong

[michaelriedl]

@Dmitry-cybe

Are you trying to build on Linux or Windows? It looks like you do not have cmake installed. If you are on Linux you can do

sudo apt install cmake

If you are on Windows, you may need to reboot and try again if you just installed the VS Build Tools.

[Dmitry-cybe]

Thanks, it worked. I installed private mipt, there was always a mistake with llama, only you found a tool that helped.

[wq7278]

Thanks, this helped a lot. in windows 10. running it in PowerShell worked. problems in Command prompt.