Closed joyryder closed 1 year ago
I am on windows 10 pro 21H2 and cannot install prebuild GPTQ wheel with the command: python -m pip install quant_cuda-0.0.0-cp310-cp310-win_amd64.whl Using anaconda python version Python 3.9.16. Any help would be appreciated.
try: pip install https://github.com/acpopescu/bitsandbytes/releases/download/v0.37.2-win.1/bitsandbytes-0.37.2-py3-none-any.whl
from: https://www.reddit.com/r/Oobabooga/comments/12eniem/bitsandbytes_now_for_windows_8bit_cuda_functions/
@joyryder rewrote the whole guide. issue should be solved
I am on windows 10 pro 21H2 and cannot install prebuild GPTQ wheel with the command: python -m pip install quant_cuda-0.0.0-cp310-cp310-win_amd64.whl Using anaconda python version Python 3.9.16. Any help would be appreciated.