facebookresearch / xformers

Hackable and optimized Transformers building blocks, supporting a composable construction.
https://facebookresearch.github.io/xformers/
Other
8.41k stars 597 forks source link

Does the latest xformers wheel uploaded now support cuda11.8 and cuda12.4? #1115

Open leij0318 opened 19 hours ago

leij0318 commented 19 hours ago

Torch has recently been updated to 2.4.1. After installing torch, xformers also needs to be installed with the latest 0.0.28 post1 version. However, I did not find the xformers wheel with the prefixes cu118 and cu124 in the uploaded 0.0.28 version at https://download.pytorch.org/whl/cu124/xformers and https://download.pytorch.org/whl/cu118/xformers. eed28aa8-e6f9-497b-8f01-4aa46b796cbb

a8032c0a-77d5-44ec-91ef-5ae26c6aa583

So I want to know whether xformers 0.0.28 version no longer builds wheels for cu118, cu121, and cu124? Or the wheels uploaded without the specific prefix cu118/cu124 are not compiled with cuda?

.

leij0318 commented 19 hours ago

I looked for the deleted content of release 0.0.28 and saw that compatibility with PyTorch < 2.4 was deleted conda build of python 3.9 was deleted windows pip wheels of cuda 12.1 and 11.8 were deleted but in the release details of 0.0.28.post1, it shows that the wheels of cuda 12.4 were uploaded correctly.

I have cuda11.8 and cuda12.4 installed on my computer, but I enter the command python -m xformers.info in the corresponding environment respectively. However, it only shows successful loading in the cuda12.4 environment, and cuda11.8 fails to load. So xformers will only compile cuda12.4 wheels in the future, not cuda11.8 and cuda12.1?