marella / chatdocs

Chat with your documents offline using AI.
MIT License
696 stars 101 forks source link

Problem to install GTPQ #7

Closed gandolfi974 closed 1 year ago

gandolfi974 commented 1 year ago

hello,

i have a problem with the command "pip install git+https://github.com/PanQiWei/AutoGPTQ@v0.2.1"

ERROR: Failed building wheel for auto-gptq Running setup.py clean for auto-gptq Failed to build auto-gptq ERROR: Could not build wheels for auto-gptq, which is required to install pyproject.toml-based projects i have installed conda install cuda --channel nvidia/label/cuda-12.1.0 pip3 install --pre torch torchvision torchaudio --index-url https://download.pytorch.org/whl/nightly/cu121

gandolfi974 commented 1 year ago

i have to install conda install cuda --channel nvidia/label/cuda-11.6.0

gandolfi974 commented 1 year ago

i have to install conda install cuda --channel nvidia/label/cuda-11.6.0