search

LeapLabTHU / FLatten-Transformer

Official repository of FLatten Transformer (ICCV2023)
405 stars 24 forks source link

Triton implementation #31

Open hp-l33 opened 2 weeks ago

hp-l33 commented 2 weeks ago

Thank you for your excellent work!

I maintain a library implementing bi-directional linear attention with Triton, which now now supports some of your Flatten-Transformer models. By the way, it also provides preliminary support for MLLA.

Best wishes!

tian-qing001 commented 2 weeks ago

Hi @hp-l33, thanks for your efforts. I believe the fast implementation will be beneficial for the community~