search

webmachinelearning / webnn

🧠 Web Neural Network API
https://www.w3.org/TR/webnn/
Other
368 stars 45 forks source link

SSMs/Mamba models #524

Open bhack opened 7 months ago

bhack commented 7 months ago

Have we already analyzed the possibility to cover SSMs models like Mamba/VMamba? Do we require any extra ops?

https://arxiv.org/abs/2312.00752 https://arxiv.org/abs/2401.09417 https://arxiv.org/abs/2401.04081

anssiko commented 7 months ago

Thanks for the proposal. If you want to help the WG you can follow the guidelines for proposing new ops. This will help us get to this sooner. You can use this issue for your responses. Thanks for your contributions!

bhack commented 7 months ago

I don't know when I will have the bandwidth for the analysis but /cc @tridao @MzeroMiko in the case they could be interested in this in the meantime.

MzeroMiko commented 7 months ago

Thank you for your attention, we will try to add new ops into this wonderful repo in the future. We really appreciate that you can transfer those machine learning models into web side.

bhack commented 7 months ago

And Mamba video https://arxiv.org/abs/2401.14168 /cc @scott-yjyang