search

facebookresearch / VMZ

VMZ: Model Zoo for Video Modeling
Apache License 2.0
1.04k stars 155 forks source link

Kinetics preprocessing #14

Closed AustinVan closed 6 years ago

AustinVan commented 6 years ago

In the tutorial of training kinetics, we need to pre-process the video as clips(of 10second). Since the number of video is huge and the total time of each video varies, it may take time to finish the preprocessing.
can you provide your script for this?

cr-hxfan commented 6 years ago

I have a nother question, For UCF101 dataset, do we need to pre-process(like using fmmpeg) to make the video as clips(of 10 seconds)?

cr-hxfan commented 6 years ago

In addition, in the UCF101 list, there are the only test and train lists.

But where is the validation list? is it incorporated into training list?

murilovarges commented 6 years ago

Hi @AustinVan and @cr-hxfan,

The caffe2 framework has tools to preprocess videos (Caffe2 Video tools). So you don't need split videos in clips (e.g. clips with 32 frames).

Basically, you need to create an LMDB dataset with raw videos to do temporal jittering (Example LMBD with Raw Videos) or and LMDB with videos and start frame to extract dense features after train the model (Exemple LMDB for Feature Extraction).

cr-hxfan commented 5 years ago

@murilovarges Thanks for the reply.