search

state-spaces / mamba

Mamba SSM architecture
Apache License 2.0
13.25k stars 1.13k forks source link

Minimalist version of Mamba #53

Open Zihan-Liu-00 opened 11 months ago

Zihan-Liu-00 commented 11 months ago

I'm looking for a very simple version for Mamba. And a teaching video of implementation will be great. I know professors are very busy, but are there any enthusiastic netizens to do tutorials?

dejardim commented 11 months ago

I would appreciate a tutorial as well! I'm a computer science student from CIn-UFPE, and we have recently established a GenAI Lab. We are interested in building a Minimal Mamba Pretrained Model with a Brazilian Portuguese language data.

albertfgu commented 11 months ago

We'd be glad to see community effort here!

G-Wamat commented 11 months ago

It would be a pleasure to build a tutorial focused on Mamba. I am also a student at https://portal.cin.ufpe.br/

LucasFig0 commented 11 months ago

I am a student at cin as well and i would like to see this happening

evelynmitchell commented 11 months ago

I found this Mamba explainer helpful: https://www.youtube.com/watch?v=ouF-H35atOY That pointed to the very thorough Annotated S4: https://srush.github.io/annotated-s4/

I hope this helps.

johnma2006 commented 11 months ago

Hi all, I wrote a minimal implementation here: https://github.com/johnma2006/mamba-minimal/tree/master. Hope it helps!