search

bitsandbytes-foundation / bitsandbytes

Accessible large language models via k-bit quantization for PyTorch.
https://huggingface.co/docs/bitsandbytes/main/en/index
MIT License
6.05k stars 607 forks source link

make: No rule to make target ' cuda10x' #928

Open jackaihfia2334 opened 9 months ago

jackaihfia2334 commented 9 months ago

(base) xxx@ amax:/data2/pkgs/bitsandbytes-0.37.0$ make cuda10x CUDA_VERSION=102 make: No rule to make target ' cuda10x'. Stop.

younesbelkada commented 9 months ago

Hi @jackaihfia2334 looking at the makefile: https://github.com/TimDettmers/bitsandbytes/blob/main/Makefile I think cuda10x is not supported, can you try with cuda >= 11x ?

alistairwgillespie commented 7 months ago

@younesbelkada That file doesn't exist anymore. Any ideas why?

younesbelkada commented 7 months ago

@alistairwgillespie we recently moved to using cmake, can you follow the instruction guidelines here: https://huggingface.co/docs/bitsandbytes/main/en/installation ?

alistairwgillespie commented 7 months ago

@younesbelkada thank you for your rapid reply. I gave this a go and I still get the following error:

https://github.com/OpenAccess-AI-Collective/axolotl/issues/1280

I can copy over the same issue to bitsandbytes with a more complete set of traces - I've tried a bunch of different parameters.

xinyuegtxy commented 7 months ago

@alistairwgillespie we recently moved to using cmake, can you follow the instruction guidelines here: https://huggingface.co/docs/bitsandbytes/main/en/installation ?

hehehehehhe, why changed so quickly?