OpenGVLab / VideoMAEv2

[CVPR 2023] VideoMAE V2: Scaling Video Masked Autoencoders with Dual Masking
https://arxiv.org/abs/2303.16727
MIT License
444 stars 45 forks source link

Knowledge distillation code #61

Open rixejzvdl649 opened 2 weeks ago

rixejzvdl649 commented 2 weeks ago

Knowledge distillation: A good teacher is patient and consistent

tensorflow: https://github.com/google-research/big_vision/tree/main/big_vision/configs/proj/distill

Do you have plans to open source the distillation code?

rixejzvdl649 commented 2 weeks ago

img_v3_02bq_8ead65cb-970b-45f7-ad83-40590b86828g