qwopqwop200 / GPTQ-for-LLaMa

4 bits quantization of LLaMA using GPTQ
Apache License 2.0
2.98k stars 457 forks source link

Unable to run 'python setup_cuda.py install' #242

Open ghost opened 1 year ago

ghost commented 1 year ago

Hello, I'm attempting to execute the following steps in this document: https://huggingface.co/blog/chatbot-amd-gpu But I get stuck at this point: Unable to run 'python setup_cuda.py install'

It seems like something is missing inorder to run. I dont have much experience with python itself. I ran pip install -r requirements.txt which ran without any errors. Also to note this was on the cuda branch.

Logs: logs.txt

Does someone have a possible solution for the given problem? Thanks in advance.