search

Hprairie / Bi-Mamba2

A Triton Kernel for incorporating Bi-Directionality in Mamba2
45 stars 1 forks source link

Triton version? #2

Closed YicongHong closed 3 weeks ago

YicongHong commented 3 weeks ago

Hi Hayden, Thanks for your amazing development of bimamba2! I tried to follow the Module API but got some errors with Triton-2.1.0 (I used this for Mamba and Mamba-2 and Hydra), just want to confirm what is the correct version to use?

With Triton-2.1.0, I got "AttributeError: module 'triton.language' has no attribute 'flip'".

Thanks!

Liu-zhi-chao commented 3 weeks ago

Hi Hayden, Thanks for your amazing development of bimamba2! I tried to follow the Module API but got some errors with Triton-2.1.0 (I used this for Mamba and Mamba-2 and Hydra) and Triton-3.0.0, just want to confirm what is the correct version to use?

With Triton-2.1.0, I got "AttributeError: module 'triton.language' has no attribute 'flip'".

Thanks!

I have also faced the same problem as yours. You can install Triton-3.0.0 to solve this problem.

Hprairie commented 3 weeks ago

Yes I should add a note about that. I have only used triton 3.0.0

YicongHong commented 3 weeks ago

Thanks @Liu-zhi-chao and @Hprairie, works well now :) Cheers