Awesome-Mamba-Collection

Welcome to Awesome Mamba Resources! This repository is a curated collection of papers, tutorials, videos, and other valuable resources related to Mamba. Whether you're a beginner or an experienced user, this collection aims to provide a comprehensive reference for all things Mamba. Explore the latest research papers, dive into helpful tutorials, and discover insightful videos to enhance your understanding and proficiency in Mamba. Join us in this open collaboration to foster knowledge sharing and empower the Mamba community. Let's embark on an exciting journey with Mamba!

Feel free to modify and customize this introduction according to your preferences. Good luck with your repository! If you have any other questions, feel free to ask. -by ChatGPT

If you want to see the star count of each paper's code, switch to this.

Enjoy it below!

• Papers
  • Architecture
  • Theoretical Analysis
  • Vision
  • Language
  • Multi-Modal
  • Spatio-Temporal
  • Diffusion
  • Medical
  • Tabular Data
  • Graph
  • Point Cloud
  • Time Series
  • Speech
  • Recommendation
  • Reinforcement Learning
  • Survey
• Tutorials
  • Blogs
  • Videos
  • Books
  • Codes
  • Other Awesome Mamba List
• Contributions
• Citation
• Acknowledgement

Papers

Architecture

• Mamba: Linear-Time Sequence Modeling with Selective State Spaces [paper] [code] (2023.12.01)
• MoE-Mamba: Efficient Selective State Space Models with Mixture of Experts [paper] [code] (2024.01.08)
• BlackMamba: Mixture of Experts for State-Space Models [paper] [code] (2024.02.01)
• Hierarchical State Space Models for Continuous Sequence-to-Sequence Modeling [paper] [homepage] (2024.02.15)
• DenseMamba: State Space Models with Dense Hidden Connection for Efficient Large Language Models [paper] [code] (2024.02.26)
• Griffin: Mixing Gated Linear Recurrences with Local Attention for Efficient Language Models [paper] [code] (2024.02.29)
• Jamba: A Hybrid Transformer-Mamba Language Model [paper] [code] (2024.03.28)
• (ICML 2024, Mamba-2) Transformers are SSMs: Generalized Models and Efficient Algorithms with Structured State Space Duality [paper] [poster] [code] (2024.05.31)
• Jamba-1.5: Hybrid Transformer-Mamba Models at Scale [paper] (2024.08.22)
• (ICCAD 2024) MARCA: Mamba Accelerator with ReConfigurable Architecture [paper] (2024.09.16)
• S7: Selective and Simplified State Space Layers for Sequence Modeling [paper] (2024.10.04)

Theoretical Analysis

• StableSSM: Alleviating the Curse of Memory in State-space Models through Stable Reparameterization [paper] (2023.11.24)
• The Hidden Attention of Mamba Models [paper] [code] (2024.03.03)
• Understanding Robustness of Visual State Space Models for Image Classification [paper] (2024.03.16)
• From Generalization Analysis to Optimization Designs for State Space Models [paper] (2024.05.04)
• Demystify Mamba in Vision: A Linear Attention Perspective [paper] [code] (2024.05.26)
• A Unified Implicit Attention Formulation for Gated-Linear Recurrent Sequence Models [paper] (2024.05.26)
• The Expressive Capacity of State Space Models: A Formal Language Perspective [paper] (2024.05.27)
• Unlocking the Secrets of Linear Complexity Sequence Model from A Unified Perspective [paper] (2024.05.27)
• (ICML 2024) Transformers are SSMs: Generalized Models and Efficient Algorithms with Structured State Space Duality [paper] [poster] [code] (2024.05.31)
• Parallelizing Linear Transformers with the Delta Rule over Sequence Length [paper] [code] (2024.06.10)
• MambaLRP: Explaining Selective State Space Sequence Models [paper] (2024.06.11)
• Towards a theory of learning dynamics in deep state space models [paper] (2024.07.10)
• Lambda-Skip Connections: the architectural component that prevents Rank Collapse [paper] (2024.10.14)

Vision

• (ICML 2024) Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space Model [paper] [code] (2024.01.17)
• VMamba: Visual State Space Model [paper] [code] (2024.01.18)
• U-shaped Vision Mamba for Single Image Dehazing [paper] (2024.02.06)
• Scalable Diffusion Models with State Space Backbone [paper] [code] (2024.02.08)
• Mamba-ND: Selective State Space Modeling for Multi-Dimensional Data [paper] (2024.02.08)
• Pan-Mamba: Effective pan-sharpening with State Space Model [paper] (2024.02.19)
• (ECCV 2024) MambaIR: A Simple Baseline for Image Restoration with State-Space Model [paper] [code] (2024.02.23)
• (CVPR 2024 spotlight) State Space Models for Event Cameras [paper] [code] (2024.02.23)
• Res-VMamba: Fine-Grained Food Category Visual Classification Using Selective State Space Models with Deep Residual Learning [paper] [code] (2024.02.24)
• MiM-ISTD: Mamba-in-Mamba for Efficient Infrared Small Target Detection [paper] [code] (2024.03.04)
• Motion Mamba: Efficient and Long Sequence Motion Generation with Hierarchical and Bidirectional Selective SSM [paper] [code] (2024.03.12)
• LocalMamba: Visual State Space Model with Windowed Selective Scan [paper] [code] (2024.03.14)
• EfficientVMamba: Atrous Selective Scan for Light Weight Visual Mamba [paper] (2024.03.15)
• VmambaIR: Visual State Space Model for Image Restoration [paper] [code] (2024.03.18)
• (ECCV 2024) ZigMa: Zigzag Mamba Diffusion Model [paper] [code] [project] (2024.03.20)
• SiMBA: Simplified Mamba-Based Architecture for Vision and Multivariate Time series [paper] (2024.03.22)
• PlainMamba: Improving Non-Hierarchical Mamba in Visual Recognition [paper] [code] (2024.03.26)
• ReMamber: Referring Image Segmentation with Mamba Twister [paper] (2024.03.26)
• Gamba: Marry Gaussian Splatting with Mamba for single view 3D reconstruction [paper] (2024.03.27)
• RSMamba: Remote Sensing Image Classification with State Space Model [paper] [code] (2024.03.28)
• MambaMixer: Efficient Selective State Space Models with Dual Token and Channel Selection [paper] (2024.03.29)
• HSIMamba: Hyperpsectral Imaging Efficient Feature Learning with Bidirectional State Space for Classification [paper] (2024.03.30)
• Samba: Semantic Segmentation of Remotely Sensed Images with State Space Model [paper] [code] (2024.04.02)
• RS-Mamba for Large Remote Sensing Image Dense Prediction [paper] [code] (2024.04.03)
• RS3Mamba: Visual State Space Model for Remote Sensing Images Semantic Segmentation [paper] (2024.04.03)
• InsectMamba: Insect Pest Classification with State Space Model [paper] (2024.04.04)
• RhythmMamba: Fast Remote Physiological Measurement with Arbitrary Length Videos [paper] [code] (2024.04.09)
• Simba: Mamba augmented U-ShiftGCN for Skeletal Action Recognition in Videos [paper] (2024.04.11)
• FusionMamba: Efficient Image Fusion with State Space Model [paper] (2024.04.11)
• DGMamba: Domain Generalization via Generalized State Space Model [paper] [code] (2024.04.11)
• SpectralMamba: Efficient Mamba for Hyperspectral Image Classification [paper] (2024.04.12)
• FreqMamba: Viewing Mamba from a Frequency Perspective for Image Deraining [paper] (2024.04.15)
• HSIDMamba: Exploring Bidirectional State-Space Models for Hyperspectral Denoising [paper] (2024.04.15)
• A Novel State Space Model with Local Enhancement and State Sharing for Image Fusion [paper] (2024.04.15)
• FusionMamba: Dynamic Feature Enhancement for Multimodal Image Fusion with Mamba [paper] [code] (2024.04.15)
• MambaAD: Exploring State Space Models for Multi-class Unsupervised Anomaly Detection [paper] [project] [code] (2024.04.15)
• Text-controlled Motion Mamba: Text-Instructed Temporal Grounding of Human Motion [paper] (2024.04.17)
• CU-Mamba: Selective State Space Models with Channel Learning for Image Restoration [paper] (2024.04.17)
• MambaPupil: Bidirectional Selective Recurrent model for Event-based Eye tracking [paper] (2024.04.18)
• MambaMOS: LiDAR-based 3D Moving Object Segmentation with Motion-aware State Space Model [paper] [code] (2024.04.19)
• ST-SSMs: Spatial-Temporal Selective State of Space Model for Traffic Forecasting [paper] (2024.04.20)
• MambaUIE&SR: Unraveling the Ocean's Secrets with Only 2.8 FLOPs [paper] [code] (2024.04.22)
• Spectral-Spatial Mamba for Hyperspectral Image Classification [paper] (2024.04.29)
• CLIP-Mamba: CLIP Pretrained Mamba Models with OOD and Hessian Evaluation [paper] [code] (2024.04.30)
• SSUMamba: Spatial-Spectral Selective State Space Model for Hyperspectral Image Denoising [paper] [code] (2024.05.02)
• FER-YOLO-Mamba: Facial Expression Detection and Classification Based on Selective State Space [paper] [code] (2024.05.03)
• DVMSR: Distillated Vision Mamba for Efficient Super-Resolution [paper] [code] (2024.05.05)
• Matten: Video Generation with Mamba-Attention [paper] (2024.05.05)
• MemoryMamba: Memory-Augmented State Space Model for Defect Recognition [paper] (2024.05.06)
• MambaJSCC: Deep Joint Source-Channel Coding with Visual State Space Model [paper] (2024.05.06)
• Retinexmamba: Retinex-based Mamba for Low-light Image Enhancement [paper] [code] (2024.05.06)
• SMCD: High Realism Motion Style Transfer via Mamba-based Diffusion [paper] (2024.05.06)
• VMambaCC: A Visual State Space Model for Crowd Counting [paper] (2024.05.07)
• Frequency-Assisted Mamba for Remote Sensing Image Super-Resolution [paper] (2024.05.08)
• StyleMamba : State Space Model for Efficient Text-driven Image Style Transfer [paper] (2024.05.08)
• MambaOut: Do We Really Need Mamba for Vision? [paper] [code] (2024.05.13)
• OverlapMamba: Novel Shift State Space Model for LiDAR-based Place Recognition [paper] [code] (2024.05.13)
• GMSR:Gradient-Guided Mamba for Spectral Reconstruction from RGB Images [paper] [code] (2024.05.13)
• WaterMamba: Visual State Space Model for Underwater Image Enhancement [paper] (2024.05.14)
• Rethinking Scanning Strategies with Vision Mamba in Semantic Segmentation of Remote Sensing Imagery: An Experimental Study [paper] (2024.05.14)
• Multiscale Global Attention for Abnormal Geological Hazard Segmentation [paper] (2024.05.15)
• IRSRMamba: Infrared Image Super-Resolution via Mamba-based Wavelet Transform Feature Modulation Model [paper] (2024.05.16)
• RSDehamba: Lightweight Vision Mamba for Remote Sensing Satellite Image Dehazing [paper] (2024.05.16)
• CM-UNet: Hybrid CNN-Mamba UNet for Remote Sensing Image Semantic Segmentation [paper] [code] (2024.05.17)
• NetMamba: Efficient Network Traffic Classification via Pre-training Unidirectional Mamba [paper] (2024.05.19)
• Mamba-in-Mamba: Centralized Mamba-Cross-Scan in Tokenized Mamba Model for Hyperspectral Image Classification [paper] (2024.05.20)
• 3DSS-Mamba: 3D-Spectral-Spatial Mamba for Hyperspectral Image Classification [paper] (2024.05.21)
• Multi-Scale VMamba: Hierarchy in Hierarchy Visual State Space Model [paper] [code] (2024.05.23)
• Efficient Visual State Space Model for Image Deblurring [paper] (2024.05.23)
• Scalable Visual State Space Model with Fractal Scanning [paper] (2024.05.23)
• DiM: Diffusion Mamba for Efficient High-Resolution Image Synthesis [paper] (2024.05.23)
• Mamba-R: Vision Mamba ALSO Needs Registers [paper] [code] [project] (2024.05.23)
• MambaVC: Learned Visual Compression with Selective State Spaces [paper] [code] (2024.05.24)
• Scaling Diffusion Mamba with Bidirectional SSMs for Efficient Image and Video Generation [paper] (2024.05.24)
• MambaLLIE: Implicit Retinex-Aware Low Light Enhancement with Global-then-Local State Space [paper] (2024.05.25)
• Image Deraining with Frequency-Enhanced State Space Model [paper] (2024.05.26)
• Demystify Mamba in Vision: A Linear Attention Perspective [paper] [code] (2024.05.26)
• Vim-F: Visual State Space Model Benefiting from Learning in the Frequency Domain [paper] [code] (2024.05.29)
• FourierMamba: Fourier Learning Integration with State Space Models for Image Deraining [paper] (2024.05.29)
• DeMamba: AI-Generated Video Detection on Million-Scale GenVideo Benchmark [paper] [code] (2024.05.30)
• Dual Hyperspectral Mamba for Efficient Spectral Compressive Imaging [paper] (2024.06.01)
• LLEMamba: Low-Light Enhancement via Relighting-Guided Mamba with Deep Unfolding Network [paper] (2024.06.03)
• GrootVL: Tree Topology is All You Need in State Space Model [paper] [code] (2024.06.04)
• Feasibility of State Space Models for Network Traffic Generation [paper] (2024.06.04)
• Rethinking Spiking Neural Networks as State Space Models [paper] (2024.06.05)
• Learning 1D Causal Visual Representation with De-focus Attention Networks [paper] (2024.06.06)
• MambaDepth: Enhancing Long-range Dependency for Self-Supervised Fine-Structured Monocular Depth Estimation [paper] (2024.06.06)
• Efficient 3D Shape Generation via Diffusion Mamba with Bidirectional SSMs [paper] (2024.06.07)
• Mamba YOLO: SSMs-Based YOLO For Object Detection [paper] [code] (2024.06.09)
• HDMba: Hyperspectral Remote Sensing Imagery Dehazing with State Space Model [paper] [code] (2024.06.09)
• MVGamba: Unify 3D Content Generation as State Space Sequence Modeling [paper] (2024.06.10)
• MHS-VM: Multi-Head Scanning in Parallel Subspaces for Vision Mamba [paper] (2024.06.10)
• DualMamba: A Lightweight Spectral-Spatial Mamba-Convolution Network for Hyperspectral Image Classification [paper] (2024.06.11)
• Autoregressive Pretraining with Mamba in Vision [paper] [code] (2024.06.11)
• PixMamba: Leveraging State Space Models in a Dual-Level Architecture for Underwater Image Enhancement [paper] [code] (2024.06.12)
• PyramidMamba: Rethinking Pyramid Feature Fusion with Selective Space State Model for Semantic Segmentation of Remote Sensing Imagery [paper] (2024.06.16)
• LFMamba: Light Field Image Super-Resolution with State Space Model [paper] (2024.06.18)
• Slot State Space Models [paper] (2024.06.18)
• SEDMamba: Enhancing Selective State Space Modelling with Bottleneck Mechanism and Fine-to-Coarse Temporal Fusion for Efficient Error Detection in Robot-Assisted Surgery [paper] (2024.06.22)
• Soft Masked Mamba Diffusion Model for CT to MRI Conversion [paper] [code] (2024.06.22)
• SUM: Saliency Unification through Mamba for Visual Attention Modeling [paper] [code] (2024.06.25)
• (ECCV 2024) MTMamba: Enhancing Multi-Task Dense Scene Understanding by Mamba-Based Decoders [paper] [code] (2024.07.02)
• QueryMamba: A Mamba-Based Encoder-Decoder Architecture with a Statistical Verb-Noun Interaction Module for Video Action Forecasting @ Ego4D Long-Term Action Anticipation Challenge 2024 [paper] [code] (2024.07.04)
• A Mamba-based Siamese Network for Remote Sensing Change Detection [paper] [code] (2024.07.08)
• Mamba-FSCIL: Dynamic Adaptation with Selective State Space Model for Few-Shot Class-Incremental Learning [paper] (2024.07.08)
• HTD-Mamba: Efficient Hyperspectral Target Detection with Pyramid State Space Model [paper] [code] (2024.07.09)
• MambaVision: A Hybrid Mamba-Transformer Vision Backbone [paper] [code] (2024.07.10)
• Parallelizing Autoregressive Generation with Variational State Space Models [paper] (2024.07.11)
• GraphMamba: An Efficient Graph Structure Learning Vision Mamba for Hyperspectral Image Classification [paper] (2024.07.11)
• ST-Mamba: Spatial-Temporal Mamba for Traffic Flow Estimation Recovery using Limited Data [paper] (2024.07.11)
• SR-Mamba: Effective Surgical Phase Recognition with State Space Model [paper] [code] (2024.07.11)
• DMM: Disparity-guided Multispectral Mamba for Oriented Object Detection in Remote Sensing [paper] [code] (2024.07.11)
• Parallelizing Autoregressive Generation with Variational State Space Models [paper] (2024.07.11)
• InfiniMotion: Mamba Boosts Memory in Transformer for Arbitrary Long Motion Generation [paper] [code] (2024.07.14)
• Hamba: Single-view 3D Hand Reconstruction with Graph-guided Bi-Scanning Mamba [paper] [code] (2024.07.12)
• OPa-Ma: Text Guided Mamba for 360-degree Image Out-painting [paper] (2024.07.15)
• Enhancing Temporal Action Localization: Advanced S6 Modeling with Recurrent Mechanism [paper] (2024.07.18)
• GroupMamba: Parameter-Efficient and Accurate Group Visual State Space Model [paper] [code] (2024.07.18)
• (ICML 2024 Workshop) Investigating the Indirect Object Identification circuit in Mamba [paper] [openreview] [code] (2024.07.19)
• MxT: Mamba x Transformer for Image Inpainting [paper] (2024.07.23)
• ALMRR: Anomaly Localization Mamba on Industrial Textured Surface with Feature Reconstruction and Refinement [paper] (2024.07.25)
• VSSD: Vision Mamba with Non-Casual State Space Duality [paper] [code] (2024.07.26)
• Mamba? Catch The Hype Or Rethink What Really Helps for Image Registration [paper] [code] (2024.07.26)
• PhysMamba: Leveraging Dual-Stream Cross-Attention SSD for Remote Physiological Measurement [paper] (2024.08.02)
• WaveMamba: Spatial-Spectral Wavelet Mamba for Hyperspectral Image Classification [paper] (2024.08.02)
• Spatial-Spectral Morphological Mamba for Hyperspectral Image Classification [paper] (2024.08.02)
• MambaST: A Plug-and-Play Cross-Spectral Spatial-Temporal Fuser for Efficient Pedestrian Detection [paper] [code] (2024.08.02)
• JambaTalk: Speech-Driven 3D Talking Head Generation Based on Hybrid Transformer-Mamba Language Model [paper] (2024.08.03)
• DeMansia: Mamba Never Forgets Any Tokens [paper] [code] (2024.08.04)
• JambaTalk: Speech-Driven 3D Talking Head Generation Based on Hybrid Transformer-Mamba Language Model [paper] (2024.08.03)
• Neural Architecture Search based Global-local Vision Mamba for Palm-Vein Recognition [paper] (2024.08.11)
• MetMamba: Regional Weather Forecasting with Spatial-Temporal Mamba Model [paper] (2024.08.12)
• Mamba Retriever: Utilizing Mamba for Effective and Efficient Dense Retrieval [paper] (2024.08.15)
• ColorMamba: Towards High-quality NIR-to-RGB Spectral Translation with Mamba [paper] (2024.08.15)
• OccMamba: Semantic Occupancy Prediction with State Space Models [paper] (2024.08.19)
• Multi-Scale Representation Learning for Image Restoration with State-Space Model [paper] (2024.08.19)
• (ICML ES-FoMo 2024) ExpoMamba: Exploiting Frequency SSM Blocks for Efficient and Effective Image Enhancement [paper] [code] (2024.08.19)
• MambaLoc: Efficient Camera Localisation via State Space Model [paper] (2024.08.20)
• MambaDS: Near-Surface Meteorological Field Downscaling with Topography Constrained Selective State Space Modeling [paper] (2024.08.20)
• MambaEVT: Event Stream based Visual Object Tracking using State Space Model [paper] [code] (2024.08.20)
• OMEGA: Efficient Occlusion-Aware Navigation for Air-Ground Robot in Dynamic Environments via State Space Model [paper] [code] (2024.08.20)
• UNetMamba: An Efficient UNet-Like Mamba for Semantic Segmentation of High-Resolution Remote Sensing Images [paper] [code] (2024.08.21)
• Exploring Robustness of Visual State Space model against Backdoor Attacks [paper] (2024.08.21)
• MambaCSR: Dual-Interleaved Scanning for Compressed Image Super-Resolution With SSMs [paper] (2024.08.21)
• MambaOcc: Visual State Space Model for BEV-based Occupancy Prediction with Local Adaptive Reordering [paper] [code] (2024.08.21)
• Modeling Time-Variant Responses of Optical Compressors with Selective State Space Models [paper] (2024.08.22)
• Scalable Autoregressive Image Generation with Mamba [paper] [code] (2024.08.23)
• O-Mamba: O-shape State-Space Model for Underwater Image Enhancement [paper] [code] (2024.08.23)
• MSFMamba: Multi-Scale Feature Fusion State Space Model for Multi-Source Remote Sensing Image Classification [paper] (2024.08.26)
• ShapeMamba-EM: Fine-Tuning Foundation Model with Local Shape Descriptors and Mamba Blocks for 3D EM Image Segmentation [paper] (2024.08.26)
• ZeroMamba: Exploring Visual State Space Model for Zero-Shot Learning [paper] [code] (2024.08.27)
• MTMamba++: Enhancing Multi-Task Dense Scene Understanding via Mamba-Based Decoders [paper] [code] (2024.08.27)
• DrowzEE-G-Mamba: Leveraging EEG and State Space Models for Driver Drowsiness Detection [paper] (2024.08.28)
• TrackSSM: A General Motion Predictor by State-Space Model [paper] (2024.08.31)
• A Hybrid Transformer-Mamba Network for Single Image Deraining [paper] (2024.08.31)
• Shuffle Mamba: State Space Models with Random Shuffle for Multi-Modal Image Fusion [paper] (2024.09.03)
• (IEEE MMSP 2024) Efficient Image Compression Using Advanced State Space Models [paper] (2024.09.04)
• UV-Mamba: A DCN-Enhanced State Space Model for Urban Village Boundary Identification in High-Resolution Remote Sensing Images [paper] (2024.09.05)
• DSDFormer: An Innovative Transformer-Mamba Framework for Robust High-Precision Driver Distraction Identification [paper] (2024.09.09)
• PPMamba: A Pyramid Pooling Local Auxiliary SSM-Based Model for Remote Sensing Image Semantic Segmentation [paper] (2024.09.10)
• Retinex-RAWMamba: Bridging Demosaicing and Denoising for Low-Light RAW Image Enhancement [paper] (2024.09.11)
• CollaMamba: Efficient Collaborative Perception with Cross-Agent Spatial-Temporal State Space Model [paper] (2024.09.12)
• SparX: A Sparse Cross-Layer Connection Mechanism for Hierarchical Vision Mamba and Transformer Networks [paper] [code] (2024.09.15)
• (ECCV 2024) Famba-V: Fast Vision Mamba with Cross-Layer Token Fusion [paper] (2024.09.15)
• Mamba-ST: State Space Model for Efficient Style Transfer [paper] (2024.09.16)
• (IEEE Sensors Journal) AE-IRMamba: Low-Complexity Inverted Residual Mamba for Identification of Piezoelectric Ceramic and Optical Fiber Acoustic Emission Sensors Signals [paper] (2024.09.17)
• Distillation-free Scaling of Large SSMs for Images and Videos [paper] (2024.09.18)
• GraspMamba: A Mamba-based Language-driven Grasp Detection Framework with Hierarchical Feature Learning [paper] (2024.09.22)
• Exploring Token Pruning in Vision State Space Models [paper] (2024.09.27)
• MAP: Unleashing Hybrid Mamba-Transformer Vision Backbone's Potential with Masked Autoregressive Pretraining [paper] (2024.10.01)
• Oscillatory State-Space Models [paper] (2024.10.04)
• HRVMamba: High-Resolution Visual State Space Model for Dense Prediction [paper] (2024.10.04)
• Mamba Capsule Routing Towards Part-Whole Relational Camouflaged Object Detection [paper] [code] (2024.10.05)
• IGroupSS-Mamba: Interval Group Spatial-Spectral Mamba for Hyperspectral Image Classification [paper] (2024.10.07)
• Remote Sensing Image Segmentation Using Vision Mamba and Multi-Scale Multi-Frequency Feature Fusion [paper] (2024.10.08)
• MatMamba: A Matryoshka State Space Model [paper] [code] (2024.10.09)
• (NeurIPS 2024) QuadMamba: Learning Quadtree-based Selective Scan for Visual State Space Model [paper] [code] (2024.10.09)
• CountMamba: Exploring Multi-directional Selective State-Space Models for Plant Counting [paper] (2024.10.10)
• GlobalMamba: Global Image Serialization for Vision Mamba [paper] (2024.10.14)
• V2M: Visual 2-Dimensional Mamba for Image Representation Learning [paper] (2024.10.14)
• MambaBEV: An efficient 3D detection model with Mamba2 [paper] (2024.10.16)
• MambaPainter: Neural Stroke-Based Rendering in a Single Step [paper] (2024.10.16)
• Rethinking Token Reduction for State Space Models [paper] (2024.10.16)
• Long-LRM: Long-sequence Large Reconstruction Model for Wide-coverage Gaussian Splats [paper] (2024.10.16)
• RemoteDet-Mamba: A Hybrid Mamba-CNN Network for Multi-modal Object Detection in Remote Sensing Images [paper] (2024.10.17)
• Quamba: A Post-Training Quantization Recipe for Selective State Space Models [paper] (2024.10.17)
• (NeurIPS 2024) MambaSCI: Efficient Mamba-UNet for Quad-Bayer Patterned Video Snapshot Compressive Imaging [paper] [code] (2024.10.18)
• Spatial-Mamba: Effective Visual State Space Models via Structure-Aware State Fusion [paper] [code] (2024.10.19)
• START: A Generalized State Space Model with Saliency-Driven Token-Aware Transformation [paper] [code] (2024.10.21)
• Revealing and Mitigating the Local Pattern Shortcuts of Mamba [paper] (2024.10.21)
• SpikMamba: When SNN meets Mamba in Event-based Human Action Recognition [paper] (2024.10.22)
• Topology-aware Mamba for Crack Segmentation in Structures [paper] [code] (2024.10.25)
• Adaptive Multi Scale Document Binarisation Using Vision Mamba [paper] (2024.10.30)

Language

• MambaByte: Token-free Selective State Space Model [paper] [code] (2024.01.24)
• Is Mamba Capable of In-Context Learning? [paper] (2024.02.05)
• (ICML 2024) Can Mamba Learn How to Learn? A Comparative Study on In-Context Learning Tasks [paper] (2024.02.06)
• SpaceByte: Towards Deleting Tokenization from Large Language Modeling [paper] (2024.04.22)
• State-Free Inference of State-Space Models: The Transfer Function Approach [paper] (2024.05.10)
• Mamba4KT:An Efficient and Effective Mamba-based Knowledge Tracing Model [paper] (2024.05.26)
• Zamba: A Compact 7B SSM Hybrid Model [paper] (2024.05.26)
• State Space Models are Comparable to Transformers in Estimating Functions with Dynamic Smoothness [paper] (2024.05.29)
• Mamba State-Space Models Can Be Strong Downstream Learners [paper] (2024.05.30)
• Learning to Estimate System Specifications in Linear Temporal Logic using Transformers and Mamba [paper] (2024.05.31)
• Pretrained Hybrids with MAD Skills [paper] (2024.06.02)
• LongSSM: On the Length Extension of State-space Models in Language Modelling [paper] (2024.06.04)
• Samba: Simple Hybrid State Space Models for Efficient Unlimited Context Language Modeling [paper] [code] (2024.06.04)
• How Effective are State Space Models for Machine Translation? [paper] (2024.06.07)
• State Soup: In-Context Skill Learning, Retrieval and Mixing [paper] (2024.06.12)
• An Empirical Study of Mamba-based Language Models [paper] (2024.06.12)
• DeciMamba: Exploring the Length Extrapolation Potential of Mamba [paper] [code] (2024.06.20)
• Hydra: Bidirectional State Space Models Through Generalized Matrix Mixers [paper] [code] (2024.07.13)
• MambaForGCN: Enhancing Long-Range Dependency with State Space Model and Kolmogorov-Arnold Networks for Aspect-Based Sentiment Analysis [paper] (2024.07.14)
• Longhorn: State Space Models are Amortized Online Learners [paper] [code] (2024.07.13)
• Transformers to SSMs: Distilling Quadratic Knowledge to Subquadratic Models [paper] (2024.07.14)
• ReMamba: Equip Mamba with Effective Long-Sequence Modeling [paper] (2024.08.28)
• Sparse Mamba: Reinforcing Controllability In Structural State Space Models [paper] (2024.08.31)
• DocMamba: Efficient Document Pre-training with State Space Model [paper] (2024.09.18)
• Can Mamba Always Enjoy the "Free Lunch"? [paper] (2024.10.04)
• Falcon Mamba: The First Competitive Attention-free 7B Language Model [paper] (2024.10.07)
• Stuffed Mamba: State Collapse and State Capacity of RNN-Based Long-Context Modeling [paper] (2024.10.09)
• (CIKM 2024) XRDMamba: Large-scale Crystal Material Space Group Identification with Selective State Space Model [paper] (2024.10.21)

Multi-Modal

• VL-Mamba: Exploring State Space Models for Multimodal Learning [paper] [code] (2024.03.20)
• Cobra: Extending Mamba to Multi-Modal Large Language Model for Efficient Inference [paper] [code] (2024.03.21)
• SpikeMba: Multi-Modal Spiking Saliency Mamba for Temporal Video Grounding [paper] (2024.04.01)
• Sigma: Siamese Mamba Network for Multi-Modal Semantic Segmentation [paper] [code] (2024.04.04)
• SurvMamba: State Space Model with Multi-grained Multi-modal Interaction for Survival Prediction [paper] (2024.04.11)
• MambaDFuse: A Mamba-based Dual-phase Model for Multi-modality Image Fusion [paper] (2024.04.12)
• Fusion-Mamba for Cross-modality Object Detection [paper] (2024.04.14)
• CFMW: Cross-modality Fusion Mamba for Multispectral Object Detection under Adverse Weather Conditions [paper] [code] (2024.04.25)
• Meteor: Mamba-based Traversal of Rationale for Large Language and Vision Models [paper] [code] (2024.05.24)
• Coupled Mamba: Enhanced Multi-modal Fusion with Coupled State Space Model [paper] (2024.05.28)
• S4Fusion: Saliency-aware Selective State Space Model for Infrared Visible Image Fusion [paper] (2024.05.31)
• SHMamba: Structured Hyperbolic State Space Model for Audio-Visual Question Answering [paper] (2024.06.14)
• ML-Mamba: Efficient Multi-Modal Large Language Model Utilizing Mamba-2 [paper] (2024.06.29)
• (ACM MM 2024) MambaGesture: Enhancing Co-Speech Gesture Generation with Mamba and Disentangled Multi-Modality Fusion [paper] (2024.06.29)
• MUSE: Mamba is Efficient Multi-scale Learner for Text-video Retrieval [paper] [code] (2024.08.20)
• Why mamba is effective? Exploit Linear Transformer-Mamba Network for Multi-Modality Image Fusion [paper] (2024.09.05)
• Mamba-Enhanced Text-Audio-Video Alignment Network for Emotion Recognition in Conversations [paper] (2024.09.08)
• Shaking Up VLMs: Comparing Transformers and Structured State Space Models for Vision & Language Modeling [paper] (2024.09.09)
• Mamba Fusion: Learning Actions Through Questioning [paper] (2024.09.17)
• DepMamba: Progressive Fusion Mamba for Multimodal Depression Detection [paper] (2024.09.24)
• EMMA: Empowering Multi-modal Mamba with Structural and Hierarchical Alignment [paper] (2024.10.08)
• MambaSOD: Dual Mamba-Driven Cross-Modal Fusion Network for RGB-D Salient Object Detection [paper] [code] (2024.10.19)

Spatio-Temporal

• Video Mamba Suite: State Space Model as a Versatile Alternative for Video Understanding [paper] [code] (2024.03.12)
• (CVPR 2024 Precognition Workshop) VMRNN: Integrating Vision Mamba and LSTM for Efficient and Accurate Spatiotemporal Forecasting [paper] [code] (2024.03.25)
• (IEEE TGRS 2024) ChangeMamba: Remote Sensing Change Detection with Spatio-Temporal State Space Model [paper] [code] (2024.04.04)
• ST-MambaSync: The Confluence of Mamba Structure and Spatio-Temporal Transformers for Precipitous Traffic Prediction [paper] (2024.04.24)
• SpoT-Mamba: Learning Long-Range Dependency on Spatio-Temporal Graphs with Selective State Spaces [paper] [code] (2024.06.17)
• VideoMambaPro: A Leap Forward for Mamba in Video Understanding [paper] (2024.06.27)
• VFIMamba: Video Frame Interpolation with State Space Models [paper] [code] (2024.07.02)
• VideoMamba: Spatio-Temporal Selective State Space Model [paper] [code] (2024.07.11)
• MambaVT: Spatio-Temporal Contextual Modeling for robust RGB-T Tracking [paper] (2024.08.15)
• DemMamba: Alignment-free Raw Video Demoireing with Frequency-assisted Spatio-Temporal Mamba [paper] (2024.08.20)
• Self-Supervised State Space Model for Real-Time Traffic Accident Prediction Using eKAN Networks [paper] [code] (2024.09.09)
• (ADMA 2024) Spatial-Temporal Mamba Network for EEG-based Motor Imagery Classification [paper] (2024.09.15)
• (CCBR 2024) PhysMamba: Efficient Remote Physiological Measurement with SlowFast Temporal Difference Mamba [paper] (2024.09.18)

Diffusion

• Scalable Diffusion Models with State Space Backbone [paper] [code] (2024.02.08)
• P-Mamba: Marrying Perona Malik Diffusion with Mamba for Efficient Pediatric Echocardiographic Left Ventricular Segmentation [paper] (2024.02.13)
• MD-Dose: A Diffusion Model based on the Mamba for Radiotherapy Dose Prediction [paper] [code] (2024.03.13)
• (ECCV 2024) ZigMa: Zigzag Mamba Diffusion Model [paper] [code] [project] (2024.03.20)
• SMCD: High Realism Motion Style Transfer via Mamba-based Diffusion [paper] (2024.05.06)
• VM-DDPM: Vision Mamba Diffusion for Medical Image Synthesis [paper] (2024.05.09)
• DiM: Diffusion Mamba for Efficient High-Resolution Image Synthesis [paper] (2024.05.23)
• UniAnimate: Taming Unified Video Diffusion Models for Consistent Human Image Animation [paper] [code] (2024.06.03)
• Dimba: Transformer-Mamba Diffusion Models [paper] (2024.06.03)
• LaMamba-Diff: Linear-Time High-Fidelity Diffusion Models Based on Local Attention and Mamba [paper] (2024.08.05)
• MADiff: Motion-Aware Mamba Diffusion Models for Hand Trajectory Prediction on Egocentric Videos [paper] [code] (2024.09.04)
• Mamba Policy: Towards Efficient 3D Diffusion Policy with Hybrid Selective State Models [paper] [code] (2024.09.04)
• DiSPo: Diffusion-SSM based Policy Learning for Coarse-to-Fine Action Discretization [paper] (2024.09.23)

Medical

• U-Mamba: Enhancing Long-range Dependency for Biomedical Image Segmentation [paper] [code] [dataset] [homepage] (2024.01.09)

• SegMamba: Long-range Sequential Modeling Mamba For 3D Medical Image Segmentation [paper] [code] (2024.01.24)

• MambaMorph: a Mamba-based Backbone with Contrastive Feature Learning for Deformable MR-CT Registration [paper] [code] (2024.01.24)

• Vivim: a Video Vision Mamba for Medical Video Object Segmentation [paper] [code] (2024.01.25)

• VM-UNet: Vision Mamba UNet for Medical Image Segmentation [paper] [code] (2024.02.04)

• Swin-UMamba: Mamba-based UNet with ImageNet-based pretraining [paper] [code] (2024.02.05)

• nnMamba: 3D Biomedical Image Segmentation, Classification and Landmark Detection with State Space Model [paper] [code] (2024.02.05)

• Mamba-UNet: UNet-Like Pure Visual Mamba for Medical Image Segmentation [paper] [code] (2024.02.07)

• FD-Vision Mamba for Endoscopic Exposure Correction [paper] (2024.02.09)

• Semi-Mamba-UNet: Pixel-Level Contrastive Cross-Supervised Visual Mamba-based UNet for Semi-Supervised Medical Image Segmentation [paper] [code] (2024.02.11)

• P-Mamba: Marrying Perona Malik Diffusion with Mamba for Efficient Pediatric Echocardiographic Left Ventricular Segmentation [paper] (2024.02.13)

• Weak-Mamba-UNet: Visual Mamba Makes CNN and ViT Work Better for Scribble-based Medical Image Segmentation [paper] [code] (2024.02.16)

• MambaMIR: An Arbitrary-Masked Mamba for Joint Medical Image Reconstruction and Uncertainty Estimation [paper] (2024.02.28)

• A PTM-Aware Protein Language Model with Bidirectional Gated Mamba Blocks

  [Paper] [Huggingface] [code] (2024.02.28)

• MedMamba: Vision Mamba for Medical Image Classification [paper] [code] (2024.03.06)

• Motion-Guided Dual-Camera Tracker for Low-Cost Skill Evaluation of Gastric Endoscopy [paper] (2024.03.08)

• MamMIL: Multiple Instance Learning for Whole Slide Images with State Space Models [paper] (2024.03.08)

• LightM-UNet: Mamba Assists in Lightweight UNet for Medical Image Segmentation [paper] [code] (2024.03.08)

• ClinicalMamba: A Generative Clinical Language Model on Longitudinal Clinical Notes [paper] (2024.03.09)

• Large Window-based Mamba UNet for Medical Image Segmentation: Beyond Convolution and Self-attention [paper] [code] (2024.03.12)

• MD-Dose: A Diffusion Model based on the Mamba for Radiotherapy Dose Prediction [paper] [code] (2024.03.13)

• VM-UNET-V2 Rethinking Vision Mamba UNet for Medical Image Segmentation [paper] [code] (2024.03.14)

• H-vmunet: High-order Vision Mamba UNet for Medical Image Segmentation [paper] [code] (2024.03.20)

• ProMamba: Prompt-Mamba for polyp segmentation [paper] (2024.03.20)

• UltraLight VM-UNet: Parallel Vision Mamba Significantly Reduces Parameters for Skin Lesion Segmentation [paper] [code] (2024.03.29)

• VMambaMorph: a Visual Mamba-based Framework with Cross-Scan Module for Deformable 3D Image Registration [paper] (2024.04.07)

• Vim4Path: Self-Supervised Vision Mamba for Histopathology Images [paper] [code] (2024.04.20)

• Sparse Reconstruction of Optical Doppler Tomography Based on State Space Model [paper] (2024.04.26)

• AC-MAMBASEG: An adaptive convolution and Mamba-based architecture for enhanced skin lesion segmentation [paper] [code] (2024.05.05)

• HC-Mamba: Vision MAMBA with Hybrid Convolutional Techniques for Medical Image Segmentation [paper] (2024.05.08)

• VM-DDPM: Vision Mamba Diffusion for Medical Image Synthesis [paper] (2024.05.09)

• I2I-Mamba: Multi-modal medical image synthesis via selective state space modeling [paper] [code] (2024.05.22)

• EHRMamba: Towards Generalizable and Scalable Foundation Models for Electronic Health Records [paper] (2024.05.23)

• MUCM-Net: A Mamba Powered UCM-Net for Skin Lesion Segmentation [paper] [code] (2024.05.24)

• UU-Mamba: Uncertainty-aware U-Mamba for Cardiac Image Segmentation [paper] (2024.05.25)

• Enhancing Global Sensitivity and Uncertainty Quantification in Medical Image Reconstruction with Monte Carlo Arbitrary-Masked Mamba [paper] (2024.05.27)

• Cardiovascular Disease Detection from Multi-View Chest X-rays with BI-Mamba [paper] (2024.05.28)

• fMRI predictors based on language models of increasing complexity recover brain left lateralization [paper] [code] (2024.05.28)

• SAM-VMNet: Deep Neural Networks For Coronary Angiography Vessel Segmentation [paper] (2024.06.01)

• Combining Graph Neural Network and Mamba to Capture Local and Global Tissue Spatial Relationships in Whole Slide Images [paper] [code] (2024.06.05)

• Convolution and Attention-Free Mamba-based Cardiac Image Segmentation [paper] (2024.06.09)

• MMR-Mamba: Multi-Contrast MRI Reconstruction with Mamba and Spatial-Frequency Information Fusion [paper] (2024.06.27)

• Vision Mamba for Classification of Breast Ultrasound Images [paper] (2024.07.04)

• Fine-grained Context and Multi-modal Alignment for Freehand 3D Ultrasound Reconstruction [paper] (2024.07.05)

• LGRNet: Local-Global Reciprocal Network for Uterine Fibroid Segmentation in Ultrasound Videos [paper] [code] (2024.07.08)

• SliceMamba for Medical Image Segmentation [paper] (2024.07.11)

• BioMamba: A Pre-trained Biomedical Language Representation Model Leveraging Mamba [paper] (2024.08.05)

• SMILES-Mamba: Chemical Mamba Foundation Models for Drug ADMET Prediction [paper] (2024.08.11)

• HMT-UNet: A hybird Mamba-Transformer Vision UNet for Medical Image Segmentation [paper] [code] (2024.08.21)

• Hierarchical Spatio-Temporal State-Space Modeling for fMRI Analysis [paper] (2024.08.23)

• MSVM-UNet: Multi-Scale Vision Mamba UNet for Medical Image Segmentation [paper] [code] (2024.08.25)

• LoG-VMamba: Local-Global Vision Mamba for Medical Image Segmentation [paper] [code] (2024.08.26)

• Mamba2MIL: State Space Duality Based Multiple Instance Learning for Computational Pathology [paper] [code] (2024.08.27)

• MpoxMamba: A Grouped Mamba-based Lightweight Hybrid Network for Mpox Detection [paper] [code] (2024.09.06)

• OCTAMamba: A State-Space Model Approach for Precision OCTA Vasculature Segmentation [paper] [code] (2024.09.12)

• Microscopic-Mamba: Revealing the Secrets of Microscopic Images with Just 4M Parameters [paper] [code] (2024.09.12)

• Learning Brain Tumor Representation in 3D High-Resolution MR Images via Interpretable State Space Models [paper] (2024.09.12)

• Tri-Plane Mamba: Efficiently Adapting Segment Anything Model for 3D Medical Images [paper] (2024.09.13)

• SPRMamba: Surgical Phase Recognition for Endoscopic Submucosal Dissection with Mamba [paper] (2024.09.18)

• MambaRecon: MRI Reconstruction with Structured State Space Models [paper] (2024.09.19)

• UU-Mamba: Uncertainty-aware U-Mamba for Cardiovascular Segmentation [paper] (2024.09.22)

• Protein-Mamba: Biological Mamba Models for Protein Function Prediction [paper] (2024.09.22)

• Multi-resolution visual Mamba with multi-directional selective mechanism for retinal disease detection [paper] (2024.10.11)

• UMambaAdj: Advancing GTV Segmentation for Head and Neck Cancer in MRI-Guided RT with UMamba and nnU-Net ResEnc Planner [paper] (2024.10.16)

• Taming Mambas for Voxel Level 3D Medical Image Segmentation [paper] (2024.10.20)

• R2Gen-Mamba: A Selective State Space Model for Radiology Report Generation [paper] [code] (2024.10.21)

• Bio2Token: All-atom tokenization of any biomolecular structure with Mamba [paper] (2024.10.24)

• SC-MAMBA2: Leveraging State-Space Models for Efficient Single-Cell Ultra-Long Transcriptome Modeling [paper] (2024.10.26)

Tabular Data

• MambaTab: A Simple Yet Effective Approach for Handling Tabular Data [paper] (2024.01.16)
• Mambular: A Sequential Model for Tabular Deep Learning [paper] [code] (2024.08.12)

Graph

• Graph-Mamba: Towards Long-Range Graph Sequence Modeling with Selective State Spaces [paper] [code] (2024.02.01)
• Graph Mamba: Towards Learning on Graphs with State Space Models [paper] [code] (2024.02.13)
• STG-Mamba: Spatial-Temporal Graph Learning via Selective State Space Model [paper] (2024.03.19)
• HeteGraph-Mamba: Heterogeneous Graph Learning via Selective State Space Model [paper] (2024.05.22)
• State Space Models on Temporal Graphs: A First-Principles Study [paper] (2024.06.03)
• Learning Long Range Dependencies on Graphs via Random Walks [paper] [code] (2024.06.05)
• What Can We Learn from State Space Models for Machine Learning on Graphs? [paper] [code] (2024.06.09)
• SpoT-Mamba: Learning Long-Range Dependency on Spatio-Temporal Graphs with Selective State Spaces [paper] [code] (2024.06.17)
• GraphMamba: An Efficient Graph Structure Learning Vision Mamba for Hyperspectral Image Classification [paper] (2024.07.11)
• DyGMamba: Efficiently Modeling Long-Term Temporal Dependency on Continuous-Time Dynamic Graphs with State Space Models [paper] (2024.08.08)
• DyG-Mamba: Continuous State Space Modeling on Dynamic Graphs [paper] (2024.08.13)
• Geometry Informed Tokenization of Molecules for Language Model Generation [paper] (2024.08.19)
• Mamba Meets Financial Markets: A Graph-Mamba Approach for Stock Price Prediction [paper] [code] (2024.09.26)

Point Cloud

• PointMamba: A Simple State Space Model for Point Cloud Analysis [paper] (2024.02.16)
• Point Could Mamba: Point Cloud Learning via State Space Model [paper] [code] (2024.03.01)
• 3DMambaIPF: A State Space Model for Iterative Point Cloud Filtering via Differentiable Rendering [paper] (2024.04.08)
• 3DMambaComplete: Exploring Structured State Space Model for Point Cloud Completion [paper] (2024.04.10)
• Mamba3D: Enhancing Local Features for 3D Point Cloud Analysis via State Space Model [paper] [code] (2024.04.23)
• MAMBA4D: Efficient Long-Sequence Point Cloud Video Understanding with Disentangled Spatial-Temporal State Space Models [paper] (2024.05.23)
• PoinTramba: A Hybrid Transformer-Mamba Framework for Point Cloud Analysis [paper] [code] (2024.05.24)
• LCM: Locally Constrained Compact Point Cloud Model for Masked Point Modeling [paper] (2024.05.27)
• PointABM:Integrating Bidirectional State Space Model with Multi-Head Self-Attention for Point Cloud Analysis [paper] (2024.06.10)
• Voxel Mamba: Group-Free State Space Models for Point Cloud based 3D Object Detection [paper] (2024.06.15)
• Mamba24/8D: Enhancing Global Interaction in Point Clouds via State Space Model [paper] (2024.06.25)
• Unleashing the Potential of Mamba: Boosting a LiDAR 3D Sparse Detector by Using Cross-Model Knowledge Distillation [paper] (2024.09.17)

Time Series

• Hierarchical State Space Models for Continuous Sequence-to-Sequence Modeling [paper] [code] [homepage] (2024.02.15)
• MambaStock: Selective state space model for stock prediction [paper] [code] (2024.02.29)
• MambaLithium: Selective state space model for remaining-useful-life, state-of-health, and state-of-charge estimation of lithium-ion batteries [paper] [code] (2024.03.08)
• TimeMachine: A Time Series is Worth 4 Mambas for Long-term Forecasting [paper] [code] (2024.03.14)
• Is Mamba Effective for Time Series Forecasting? [paper] [code] (2024.03.17)
• SiMBA: Simplified Mamba-Based Architecture for Vision and Multivariate Time series [paper] [code] (2024.03.22)
• MambaMixer: Efficient Selective State Space Models with Dual Token and Channel Selection [paper] [project] (2024.03.29)
• HARMamba: Efficient Wearable Sensor Human Activity Recognition Based on Bidirectional Selective SSM [paper] (2024.03.29)
• Integrating Mamba and Transformer for Long-Short Range Time Series Forecasting [paper] [code] (2024.04.23)
• Bi-Mamba4TS: Bidirectional Mamba for Time Series Forecasting [paper] [code] (2024.04.24)
• MAMCA -- Optimal on Accuracy and Efficiency for Automatic Modulation Classification with Extended Signal Length [paper] [code] (2024.05.18)
• Time-SSM: Simplifying and Unifying State Space Models for Time Series Forecasting [paper] (2024.05.25)
• MambaTS: Improved Selective State Space Models for Long-term Time Series Forecasting [paper] [code] (2024.05.26)
• Efficient Time Series Processing for Transformers and State-Space Models through Token Merging [paper] (2024.05.28)
• Joint Selective State Space Model and Detrending for Robust Time Series Anomaly Detection [paper] (2024.05.30)
• MSSC-BiMamba: Multimodal Sleep Stage Classification and Early Diagnosis of Sleep Disorders with Bidirectional Mamba [paper] (2024.05.30)
• Chimera: Effectively Modeling Multivariate Time Series with 2-Dimensional State Space Models [paper] (2024.06.06)
• TSCMamba: Mamba Meets Multi-View Learning for Time Series Classification [paper] (2024.06.06)
• C-Mamba: Channel Correlation Enhanced State Space Models for Multivariate Time Series Forecasting [paper] (2024.06.08)
• ECGMamba: Towards Efficient ECG Classification with BiSSM [paper] (2024.06.14)
• Mamba Hawkes Process [paper] (2024.07.07)
• MSegRNN:Enhanced SegRNN Model with Mamba for Long-Term Time Series Forecasting [paper] (2024.07.15)
• FMamba: Mamba based on Fast-attention for Multivariate Time-series Forecasting [paper] (2024.07.20)
• EEG-SSM: Leveraging State-Space Model for Dementia Detection [paper] (2024.07.25)
• Simplified Mamba with Disentangled Dependency Encoding for Long-Term Time Series Forecasting [paper] (2024.08.22)
• Mamba or Transformer for Time Series Forecasting? Mixture of Universals (MoU) Is All You Need [paper] [code] (2024.08.28)
• Integration of Mamba and Transformer -- MAT for Long-Short Range Time Series Forecasting with Application to Weather Dynamics [paper] (2024.09.13)
• SITSMamba for Crop Classification based on Satellite Image Time Series [paper] (2024.09.15)
• Mamba Meets Financial Markets: A Graph-Mamba Approach for Stock Price Prediction [paper] [code] (2024.09.26)
• A SSM is Polymerized from Multivariate Time Series [paper] [code] (2024.09.30)
• TIMBA: Time series Imputation with Bi-directional Mamba Blocks and Diffusion models [paper] (2024.10.08)
• Mamba4Cast: Efficient Zero-Shot Time Series Forecasting with State Space Models [paper] (2024.10.12)
• UmambaTSF: A U-shaped Multi-Scale Long-Term Time Series Forecasting Method Using Mamba [paper] (2024.10.15)
• MASER: Enhancing EEG Spatial Resolution With State Space Modeling [paper] (2024.10.16)
• MambaCPU: Enhanced Correlation Mining with State Space Models for CPU Performance Prediction [paper] [code] (2024.10.25)
• SambaMixer: State of Health Prediction of Li-ion Batteries using Mamba State Space Models [paper] [code] (2024.10.25)

Speech

• Multichannel Long-Term Streaming Neural Speech Enhancement for Static and Moving Speakers [paper] [code] (2024.03.12)
• Dual-path Mamba: Short and Long-term Bidirectional Selective Structured State Space Models for Speech Separation [paper] (2024.03.27)
• Multichannel Long-Term Streaming Neural Speech Enhancement for Static and Moving Speakers [paper] [code] (2024.03.27)
• SPMamba: State-space model is all you need in speech separation [paper] [code] (2024.04.02)
• TRAMBA: A Hybrid Transformer and Mamba Architecture for Practical Audio and Bone Conduction Speech Super Resolution and Enhancement on Mobile and Wearable Platforms [paper] (2024.05.02)
• An Investigation of Incorporating Mamba for Speech Enhancement [paper] (2024.05.10)
• SSAMBA: Self-Supervised Audio Representation Learning with Mamba State Space Model [paper] (2024.05.20)
• Mamba in Speech: Towards an Alternative to Self-Attention [paper] (2024.05.21)
• Audio Mamba: Pretrained Audio State Space Model For Audio Tagging [paper] (2024.05.22)
• Audio Mamba: Selective State Spaces for Self-Supervised Audio Representations [paper] [code] (2024.06.04)
• Audio Mamba: Bidirectional State Space Model for Audio Representation Learning [paper] [code] (2024.06.05)
• RawBMamba: End-to-End Bidirectional State Space Model for Audio Deepfake Detection [paper] (2024.06.10)
• Exploring the Capability of Mamba in Speech Applications [paper] (2024.06.24)
• DASS: Distilled Audio State Space Models Are Stronger and More Duration-Scalable Learners [paper] (2024.07.04)
• Speech Slytherin: Examining the Performance and Efficiency of Mamba for Speech Separation, Recognition, and Synthesis [paper] [code] (2024.07.13)
• SELD-Mamba: Selective State-Space Model for Sound Event Localization and Detection with Source Distance Estimation [paper] (2024.08.09)
• MusicMamba: A Dual-Feature Modeling Approach for Generating Chinese Traditional Music with Modal Precision [paper] (2024.09.04)
• TF-Mamba: A Time-Frequency Network for Sound Source Localization [paper] (2024.09.08)
• A Two-Stage Band-Split Mamba-2 Network for Music Separation [paper] [code] (2024.09.10)
• Rethinking Mamba in Speech Processing by Self-Supervised Models [paper] (2024.09.11)
• MambaFoley: Foley Sound Generation using Selective State-Space Models [paper] (2024.09.13)
• Wave-U-Mamba: An End-To-End Framework For High-Quality And Efficient Speech Super Resolution [paper] (2024.09.14)
• Leveraging Joint Spectral and Spatial Learning with MAMBA for Multichannel Speech Enhancement [paper] (2024.09.16)
• DeFT-Mamba: Universal Multichannel Sound Separation and Polyphonic Audio Classification [paper] (2024.09.19)
• (ICASSP 2025) Mamba-based Segmentation Model for Speaker Diarization [paper] [code] (2024.10.09)
• CleanUMamba: A Compact Mamba Network for Speech Denoising using Channel Pruning [paper] (2024.10.14)

Recommendation

• (RelKD@KDD 2024) Mamba4Rec: Towards Efficient Sequential Recommendation with Selective State Space Models [paper] [code] (2024.03.06)
• Uncovering Selective State Space Model's Capabilities in Lifelong Sequential Recommendation [paper] [code] (2024.03.25)
• EchoMamba4Rec: Harmonizing Bidirectional State Space Models with Spectral Filtering for Advanced Sequential Recommendation [paper] (2024.06.04)
• (CIKM 2024) Behavior-Dependent Linear Recurrent Units for Efficient Sequential Recommendation [paper] [code] (2024.06.18)
• MLSA4Rec: Mamba Combined with Low-Rank Decomposed Self-Attention for Sequential Recommendation [paper] (2024.07.18)
• MaTrRec: Uniting Mamba and Transformer for Sequential Recommendation [paper] [code] (2024.06.27)
• Bidirectional Gated Mamba for Sequential Recommendation [paper] [code] (2024.08.21)
• SSD4Rec: A Structured State Space Duality Model for Efficient Sequential Recommendation [paper] [code] (2024.09.02)
• TiM4Rec: An Efficient Sequential Recommendation Model Based on Time-Aware Structured State Space Duality Model [paper] [code] (2024.09.24)

Reinforcement Learning

• Decision Mamba: Reinforcement Learning via Sequence Modeling with Selective State Spaces [paper] [code] (2024.03.29)
• Hierarchical Decision Mamba [paper] [code] (2024.05.13)
• Is Mamba Compatible with Trajectory Optimization in Offline Reinforcement Learning? [paper] (2024.05.20)
• Deciphering Movement: Unified Trajectory Generation Model for Multi-Agent [paper] [code] (2024.05.27)
• Decision Mamba: Reinforcement Learning via Hybrid Selective Sequence Modeling [paper] (2024.05.31)
• Mamba as Decision Maker: Exploring Multi-scale Sequence Modeling in Offline Reinforcement Learning [paper] [code] (2024.06.04)
• RoboMamba: Multimodal State Space Model for Efficient Robot Reasoning and Manipulation [paper] [code] (2024.06.06)
• Decision Mamba: A Multi-Grained State Space Model with Self-Evolution Regularization for Offline RL [paper] (2024.06.08)
• MaIL: Improving Imitation Learning with Mamba [paper] (2024.06.12)
• KalMamba: Towards Efficient Probabilistic State Space Models for RL under Uncertainty [paper] (2024.06.21)
• Context-aware Mamba-based Reinforcement Learning for social robot navigation [paper] (2024.08.05)
• PTrajM: Efficient and Semantic-rich Trajectory Learning with Pretrained Trajectory-Mamba [paper] (2024.08.09)
• Decision MetaMamba: Integrating Multi-Modal Input Token Mixer Into Mamba-Based Decision Models [paper] [code] (2024.08.20)
• Mamba as a motion encoder for robotic imitation learning [paper] (2024.09.04)
• DiSPo: Diffusion-SSM based Policy Learning for Coarse-to-Fine Action Discretization [paper] (2024.09.23)
• Uncertainty Representations in State-Space Layers for Deep Reinforcement Learning under Partial Observability [paper] (2024.09.25)

Survey

• State Space Model for New-Generation Network Alternative to Transformers: A Survey [paper] [project] (2024.04.15)
• Mamba-360: Survey of State Space Models as Transformer Alternative for Long Sequence Modelling: Methods, Applications, and Challenges [paper] [project] (2024.04.24)
• A Survey on Visual Mamba [paper] (2024.04.24)
• A Survey on Vision Mamba: Models, Applications and Challenges [paper] [project] (2024.04.29)
• Vision Mamba: A Comprehensive Survey and Taxonomy [paper] [project] (2024.05.07)
• Surveying Image Segmentation Approaches in Astronomy [paper] (2024.05.23)
• Computation-Efficient Era: A Comprehensive Survey of State Space Models in Medical Image Analysis [paper] [project] (2024.05.07)
• Surveying Image Segmentation Approaches in Astronomy [paper] (2024.08.02)

Tutorials

Blogs

• The Annotated S4 [URL]
• The Annotated Mamba [URL]
• A Visual Guide to Mamba and State Space Models [URL]
• Mamba No. 5 (A Little Bit Of...) [URL]
• State Space Duality (Mamba-2) [PART1] [PART2] [PART3] [PART4]

Videos

• S4: Efficiently Modeling Long Sequences with Structured State Spaces | Albert Gu [URL]
• Mamba and S4 Explained: Architecture, Parallel Scan, Kernel Fusion, Recurrent, Convolution, Math [URL]
• MAMBA from Scratch: Neural Nets Better and Faster than Transformers [URL]

Books

• Linear State‐Space Control Systems [URL]
• Modeling sequences with structured state spaces [URL]

Codes

• The official Mamba Repository is currently only available for Linux. [URL]
• If you are searching for a runnable implementation not focused on speed,
  • mamba-minimal: Simple, minimal implementation of the Mamba SSM in one file of PyTorch. [URL]
  • mamba2-minimal: A minimal, single-file implementation of the Mamba-2 model in PyTorch. [URL]
  • mamba.py: An efficient Mamba implementation in PyTorch and MLX. [URL]
  • mamba.c: Inference of Mamba models in pure C and CUDA. [URL]

Other Awesome Mamba List

• AvivBick/awesome-ssm-ml [URL]
• yyyujintang/Awesome-Mamba-Papers [URL]
• pengzhangzhi/Awesome-Mamba [URL]

Contributions

🎉 Thank you for considering contributing to our Awesome Mamba Collection repository! 🚀

Contribute in 3 Steps

1. Fork the Repo: Fork this repo to your GitHub account.
2. Edit Content: Contribute by adding new resources or improving existing content in the README.md file.
3. Create a Pull Request: Open a pull request (PR) from your branch to the main repository.

Guidelines

• Follow the existing structure and formatting.
• Ensure added resources are relevant to State Space Models in Machine Learning.
• Verify that links work correctly.

Citation

If you find this repository useful, please consider citing our paper:

@article{cai2024mambats,
  title={MambaTS: Improved Selective State Space Models for Long-term Time Series Forecasting},
  author={Cai, Xiuding and Zhu, Yaoyao and Wang, Xueyao and Yao, Yu},
  journal={arXiv preprint arXiv:2405.16440},
  year={2024}
}

Acknowledgement

Thanks the template from Awesome-Visual-Transformer and Awesome State-Space Resources for ML