Open eschmidbauer opened 5 months ago
Thanks for pointing this out.
Is it possible to add support for Mamba2?
Now I'm focused on scaling this up, first with GLA. For what I understand Mamba2 is very similar to GLA, I might compare them all eventually, if I have enough compute.
Mamba2 was released - so current version no longer works. To fix you must install v1 with
pip install mamba-ssm==1.2.2
Is it possible to add support for Mamba2?