facebookresearch / VMZ

VMZ: Model Zoo for Video Modeling
Apache License 2.0
1.04k stars 156 forks source link

frame rate for instagram models #95

Closed albanie closed 4 years ago

albanie commented 4 years ago

Thanks for sharing the pretrained models! What was the frame rate used by the instgram models during pretraining? Apologies if it's written somewhere, I couldn't find it in the paper.

bjuncek commented 4 years ago

@albanie can you point me to the exact model? I haven't trained them but I can check the log files :)

bjuncek commented 4 years ago

also, as a relatively unrelated sidenote, your website was the most entertaining read since the US military report on the effect on atomic bomb on brewed alcoholic beverages

albanie commented 4 years ago

Thanks a lot @bjuncek! The two models I was hoping to use are: r2plus1d_34_clip8_ig65m_from_scratch_f79708462.pkl and r2plus1d_34_clip32_ig65m_from_scratch_f102649996.pkl (these linked on the model zoo page with input sizes 8x112x122 and 32x112x122). Also, great reference.

bjuncek commented 4 years ago

Hi @albanie, so "the IG data is encoded at many different frame rates. The peaks are at 24 and 30, but the fps distribution was spread out quite a bit".

albanie commented 4 years ago

OK, great - in that case I guess the models should be fairly robust to whatever I run it with. Thanks for your help!