Can I use VideoMamba in other video AI tasks?

OpenGVLab / VideoMamba

[ECCV2024] VideoMamba: State Space Model for Efficient Video Understanding

https://arxiv.org/abs/2403.06977

Apache License 2.0

785 stars 59 forks source link

Can I use VideoMamba in other video AI tasks? #86

Open moonjayden opened 1 week ago

moonjayden commented 1 week ago

VideoMamba is currently used for action classification in videos. There are several video tasks such as video segmentation, video prediction and so on. If we use Patch Embedding and Video Mamba as they are, and only replace NN Heads with task-specific heads, can the model perform other video tasks well? I would like to know your opinion. Thank you!

Andy1621 commented 1 week ago

I think it's okay and you can have a try~