TimDettmers / bitsandbytes

Accessible large language models via k-bit quantization for PyTorch.
https://huggingface.co/docs/bitsandbytes/main/en/index
MIT License
5.75k stars 584 forks source link

CI: don't build separate wheels for different Python versions #1010

Open akx opened 5 months ago

akx commented 5 months ago

We don't need to build Python wheels with both cp310 and cp311 tags; Python 3.11 (and 3.12) is fine with cp310 wheels. Since we don't actually use Python's extension ABI, that should be fine no matter what.

We just need to figure out a stable way to force always emitting a cp310 wheel. https://github.com/karellen/wheel-axle/ seems to do that but I'm a bit hesitant to add a whole new dep for that.

younesbelkada commented 5 months ago

Thanks @akx ! If I understand correctly this is only for python == 3.10 & 3.11 ? For older python versions we need to build separate wheels right?

akx commented 5 months ago

No, a. cp38 wheel should work just as fine (though it needs a bit of experimentation).