Closed yja1 closed 2 months ago
This issue is stale because it has been open for 7 days with no activity.
This issue was closed because it has been inactive for 7 days since being marked as stale.
I experienced the same issue. I think it had to do with the wrong version. I had torch+cu124 installed and xformers==0.0.28 something.
python.exe -m pip uninstall xformers torch torchvision torchaudio
python.exe -m pip install xformers torch torchvision torchaudio --index-url https://download.pytorch.org/whl/cu121
solved it for me.
Now I have:
xformers==0.0.27.post2
torch==2.4.0+cu121
torchvision==0.19.0+cu121
torchaudio==2.4.0+cu121
in block.py 476 line module 'xformers.ops.fmha' has no attribute 'BlockDiagonalMask' use rocm/xformers