Add support for Youtube-8M?

open-mmlab / mmaction2

OpenMMLab's Next Generation Video Understanding Toolbox and Benchmark

https://mmaction2.readthedocs.io

Apache License 2.0

4.18k stars 1.22k forks source link

Add support for Youtube-8M? #851

Closed Jacobew closed 3 years ago

Jacobew commented 3 years ago

Hi, do you have any plan of supporting training for Youtube-8M? This is a multi-label video classification dataset of large scale, and it releases two kinds of features, i.e., frame-level (1.5T) and video-level features (30+G). How can I train on this dataset with the already available features?

kennymckormick commented 3 years ago

Currently, we do not have a plan for Youtube-8M. For Youtube-8M classification, algorithms should focus on how to aggregate the frame-level feature. You can refer to works like NetVLAD for Youtube-8M classification. Besides, training an MLP or linear-SVM with video-level features also serves as a baseline.