No support for pythorch 2.3.1+rocm6

[srijan789]

🚀 Feature

I'd love to be able to use xformers with my rx7900GRE, but currently face the following errors:

WARNING:xformers:WARNING[XFORMERS]: xFormers can't load C++/CUDA extensions. xFormers was built for:
    PyTorch 2.3.1+cu121 with CUDA 1201 (you have 2.3.1+rocm6.0)

Motivation

I believe the demand for compatibility for AMD cards will rise

[danthe3rd]

Hi, We don't have builds for AMD at the moment. Might come in the future, but can't promise anything (or any ETA) at this point.

[unclemusclez]

you can download xformers from the pytorch website directly pip3 install xformers==0.0.27 --index-url https://download.pytorch.org/whl/rocm6.1

you may need to upgrade to rocm6.1

[aihopper]

you can download xformers from the pytorch website directly pip3 install xformers==2.3.1 --index-url https://download.pytorch.org/whl/rocm6.1

I am not sure but I think you meant 0.0.27 and not 2.3.1, that should be pytorch's version

[unclemusclez]

@aihopper you right