search

state-spaces / mamba

Mamba SSM architecture
Apache License 2.0
12.42k stars 1.04k forks source link

Possible using tarbular data as input #165

Open HelloWorldLTY opened 7 months ago

HelloWorldLTY commented 7 months ago

Hi, I wonder if mamba can replace the MLP layers for tabular data analysis. Can I directly use reshape to increase the dimensions of input data? Thanks.

tridao commented 7 months ago

We don't have much experience with tabular data but you can try.

alxndrTL commented 7 months ago

Hello, a recent paper used Mamba for tabular data : MambaTab: A Simple Yet Effective Approach for Handling Tabular Data. Hope this helps!

HelloWorldLTY commented 7 months ago

Hi, thanks for your introduce. But I think this paper is... closed-resource? And I think they are comparing MLP without techniques like dropout and batchnorm, so it is hard to say the fairness.

AnFreTh commented 2 months ago

We created an easy to use adaptation for tabular data: mambular Not quite finished yet, but the initial results are quite promising :)