search

assafbk / DeciMamba

Official Implementation Of The Paper: `DeciMamba: Exploring the Length Extrapolation Potential of Mamba'
MIT License
20 stars 1 forks source link

Mamba2 #1

Open DanFosing opened 3 months ago

DanFosing commented 3 months ago

Are there any plans to add decimated Mamba-2? Also is there a chance we will see some implementations based on transformers package implementations of mamba? https://github.com/huggingface/transformers/tree/main/src/transformers/models/mamba2 https://github.com/huggingface/transformers/tree/main/src/transformers/models/mamba

assafbk commented 3 months ago

Hi, Thank you for your interest. I am currently on vacation, will have a look when I get back.