Open Oxi84 opened 1 month ago
Assuming you're referring to FlashAttention-3: Yes, see at the bottom of this section in the main README: https://github.com/Dao-AILab/flash-attention/blob/7ef24848cf2f855077cef88fe122775b727dcd74/README.md#flashattention-3-beta-release
cd hopper
python setup.py install
Thanks. I mean for flash attention 2, actually, but that is quite similar. And I am not sure if flash 3 works on Rtx 3090.
Do you mean?
git clone https://github.com/Dao-AILab/flash-attention/ cd hopper python setup.py install
Yes, exactly! To be really pedantic, you'd have to do cd flash-attention/hopper
instead of cd hopper
if following your commands exactly. :)
Hello, how can I install this without pip? From source?