search

OpenGVLab / VideoMamba

[ECCV2024] VideoMamba: State Space Model for Efficient Video Understanding
https://arxiv.org/abs/2403.06977
Apache License 2.0
751 stars 58 forks source link

Self-distillation for video #72

Open isacciobota opened 1 month ago

isacciobota commented 1 month ago

Is self-distillation only implemented for image processing model? videomamba_distill.py is only in the image_sm/models folder. I would like to use videoMamba as a backbone for video 3D pose estimation but not sure if self-distillation works for video.

Andy1621 commented 1 month ago

Hi! I only use self-distillation for image classification to avoid the overfitting issues, since it runs normal for video tasks.