Can I use VideoMamba as a video encoder?

OpenGVLab / VideoMamba

[ECCV2024] VideoMamba: State Space Model for Efficient Video Understanding

https://arxiv.org/abs/2403.06977

Apache License 2.0

846 stars 61 forks source link

Can I use VideoMamba as a video encoder? #65

Open ericsua opened 4 months ago

ericsua commented 4 months ago

Can I run VideoMamba as a video encoder? I want to feed VideoMamba some videos (custom dataset) and extract the embeddings, such as the feature vectors in the penultimate layer before classification. If so, do you already have a script to run the model in pure inference, or could you guide me on how to do it?

Thanks!

ilileun commented 4 months ago

I am also curious about this part.

CrazyGeG commented 3 months ago

I'm also interested about this!

Andy1621 commented 3 months ago

Hi! I think you can directly adapt the evaluation code to do it~