search

turboderp / exui

Web UI for ExLlamaV2
MIT License
449 stars 43 forks source link

ninja: build stopped: subcommand failed. #34

Closed kurugai closed 9 months ago

kurugai commented 9 months ago

The following error occurs during installation. I don't know why. I hope you can tell me the solution.

language : python 3.10 environment: win11 wsl ubuntu

conda create -n exui python=3.10 conda activate exui git clone https://github.com/turboderp/exui cd exui pip install -r requirements.txt python server.py

[18/38] c++ -MMD -MF ext_bindings.o.d -DTORCH_EXTENSION_NAME=exllamav2_ext -DTORCH_API_INCLUDE_EXTENSION_H -DPYBIND11_COMPILER_TYPE=\"_gcc\" -DPYBIND11_STDLIB=\"_libstdcpp\" -DPYBIND11_BUILD_ABI=\"_cxxabi1011\" -I/root/miniconda3/envs/exui/lib/python3.10/site-packages/exllamav2/exllamav2_ext -isystem /root/miniconda3/envs/exui/lib/python3.10/site-packages/torch/include -isystem /root/miniconda3/envs/exui/lib/python3.10/site-packages/torch/include/torch/csrc/api/include -isystem /root/miniconda3/envs/exui/lib/python3.10/site-packages/torch/include/TH -isystem /root/miniconda3/envs/exui/lib/python3.10/site-packages/torch/include/THC -isystem /root/miniconda3/envs/exui/include/python3.10 -D_GLIBCXX_USE_CXX11_ABI=0 -fPIC -std=c++17 -O3 -c /root/miniconda3/envs/exui/lib/python3.10/site-packages/exllamav2/exllamav2_ext/ext_bindings.cpp -o ext_bindings.o ninja: build stopped: subcommand failed.

turboderp commented 9 months ago

The compilation error happened before that message, and I would guess it's due to not having the CUDA toolkit installed? You can try installing one of the prebuilt ExLlamaV2 wheels if that's the case.

kurugai commented 9 months ago

@turboderp Thank you for your reply. I've tried the way you told me many times, but it didn't work out if my computer environment was weird. But I had a docker image on Reddit that someone else created, so I used it and succeeded.