Can I use VideoMamba as a video encoder?

OpenGVLab / VideoMamba

[ECCV2024] VideoMamba: State Space Model for Efficient Video Understanding

https://arxiv.org/abs/2403.06977

Apache License 2.0

708 stars 52 forks source link

Can I use VideoMamba as a video encoder? #65

Open ericsua opened 2 weeks ago

ericsua commented 2 weeks ago

Can I run VideoMamba as a video encoder? I want to feed VideoMamba some videos (custom dataset) and extract the embeddings, such as the feature vectors in the penultimate layer before classification. If so, do you already have a script to run the model in pure inference, or could you guide me on how to do it?

Thanks!

ilileun commented 1 week ago

I am also curious about this part.