Modalities / modalities

A framework for training multimodal foundation models.
MIT License
39 stars 3 forks source link

Integrate MoE-Mamba #91

Open mali-git opened 4 months ago

mali-git commented 4 months ago

Paper: https://arxiv.org/pdf/2401.04081.pdf Code: https://github.com/kyegomez/MoE-Mamba/blob/main/moe_mamba/model.py