Release v44 not available for Mac

[ACMCMC]

System Info

platform: Mac

Reproduction

pip install bitsandbytes

It will install v42 instead of v44.

Then, if you try to load any model with quantization, you will get this error:

ImportError: Using bitsandbytes 4-bit quantization requires the latest version of bitsandbytes: pip install -U bitsandbytes

Expected behavior

Installing v44 shouldn't show any import errors. But it currently does, on Mac systems, as the latest available version for Mac is v42.

Indeed, while v42 had support for all architectures:

---

Built Distribution

bitsandbytes-0.42.0-py3-none-any.whl (105.0 MB view hashes)

Uploaded Jan 8, 2024 Python 3

----- [v44](https://pypi.org/project/bitsandbytes/0.44.0/#files) only has support for Windows and Linux: -----

Built Distributions

bitsandbytes-0.44.0-py3-none-win_amd64.whl (121.5 MB view hashes)

Uploaded Sep 24, 2024 Python 3 Windows x86-64

bitsandbytes-0.44.0-py3-none-manylinux_2_24_x86_64.whl (122.4 MB view hashes)

Uploaded Sep 24, 2024 Python 3 manylinux: glibc 2.24+ x86-64

-----

matthewdouglas commented 1 week ago

Hi @ACMCMC, None of the releases are supported on macOS yet. Releases up through 0.42.0 were incorrectly tagged as supporting all platforms, but this was an oversight. Those older wheels only contain x86-64 binaries for Linux.

ACMCMC commented 1 week ago

In that case, I'd propose that Mac users should get a warning, rather than being told to "use the latest version" of something that they can't use at all... 🙏🏻

• © Githubissues.
• Githubissues is a development platform for aggregating issues.

[matthewdouglas]

Hi @ACMCMC, None of the releases are supported on macOS yet. Releases up through 0.42.0 were incorrectly tagged as supporting all platforms, but this was an oversight. Those older wheels only contain x86-64 binaries for Linux.

[ACMCMC]

In that case, I'd propose that Mac users should get a warning, rather than being told to "use the latest version" of something that they can't use at all... 🙏🏻