search

Dao-AILab / flash-attention

Fast and memory-efficient exact attention
BSD 3-Clause "New" or "Revised" License
13.1k stars 1.18k forks source link

How to i install this? #1050

Open Oxi84 opened 1 month ago

Oxi84 commented 1 month ago

Hello, how can I install this without pip? From source?

janEbert commented 1 month ago

Assuming you're referring to FlashAttention-3: Yes, see at the bottom of this section in the main README: https://github.com/Dao-AILab/flash-attention/blob/7ef24848cf2f855077cef88fe122775b727dcd74/README.md#flashattention-3-beta-release

cd hopper
python setup.py install
Oxi84 commented 1 month ago

Thanks. I mean for flash attention 2, actually, but that is quite similar. And I am not sure if flash 3 works on Rtx 3090.

Do you mean?

git clone https://github.com/Dao-AILab/flash-attention/ cd hopper python setup.py install

janEbert commented 1 month ago

Yes, exactly! To be really pedantic, you'd have to do cd flash-attention/hopper instead of cd hopper if following your commands exactly. :)