Flash Attention Triton for Mi50s

ROCm / triton

Development repository for the Triton language and compiler

MIT License

80 stars 23 forks source link

Flash Attention Triton for Mi50s #461

Closed ThePerfectComputer closed 5 months ago

ThePerfectComputer commented 6 months ago

I'm sitting on a stockpile of AMD Mi50s. I've been unable to get flash attention to run on them. I'm wondering if there are any plans for a flash attention triton implementation. Perhaps one that will run on the Mi50s?

zhanglx13 commented 6 months ago

@ThePerfectComputer Let me ask around if we still support MI50 GPUs.

ThePerfectComputer commented 6 months ago

Alright. Also, I'd be willing to pay for support for porting FA to the MI50.

zhanglx13 commented 6 months ago

@ThePerfectComputer Unfortunately we do not, and plan not to in the future, support FA on MI50 GPUs.