search

facebookresearch / AVT

Code release for ICCV 2021 paper "Anticipative Video Transformer"
Apache License 2.0
152 stars 28 forks source link

Can I train AVT on RGB frames? #37

Closed forrestsz closed 2 years ago

forrestsz commented 2 years ago

Hi, the official epic-kitchen provide both the rgb-frame and raw videso source, i want to ask, can i train your model in the rgb-frames, since the raw videos are too large to download for me. if yes, would it lead to lower performance?

thanks!

rohitgirdhar commented 2 years ago

Hi @linqinghong thanks for your interest. I haven't experimented with the frames but in principle it should be possible to train with those too. I'm not sure what frame-rate the frames are extracted at, but given I anyway sample at 1FPS for many experiments, frames should give reasonably similar performance. You would have to change the data loaders etc though to make it work with frames

forrestsz commented 2 years ago

thanks!