facebookarchive / C3D

C3D is a modified version of BVLC caffe to support 3D ConvNets.
Other
1.16k stars 507 forks source link

Doubt about the model #328

Closed rcrespocano closed 6 years ago

rcrespocano commented 6 years ago

Hi all,

I am not sure if this code is related to paper "Learning Spatiotemporal Features with 3D Convolutional Networks" or to paper "ConvNet Architecture Search for Spatiotemporal Feature Learning".

In the second one is said that "For the sake of reproducible research,the source code and pre-trained models are available at http://github.com/facebook/C3D". It seems that this code is related to the first paper and not to the second paper. Besides, in the second paper pretrained models are not named as 'C3D' because this is the name for the oldest study. This confuses me a lot.

Can you help me?

Thank you in advance.

Best, Rubén

dutran commented 6 years ago

Rube'n, C3D is v1.0 and Res3D is v1.1

rcrespocano commented 6 years ago

Thank you for your quick reply!

In which folder are located the pre-trained models?

Thank you so much in advance. And... good job! :)

Best, Rubén

dutran commented 6 years ago

https://github.com/facebook/C3D/blob/master/C3D-v1.1/examples/c3d_ucf101_feature_extraction/feature_extraction.sh#L2

rcrespocano commented 6 years ago

In the paper it is said that for the training process it is extracted randomly five 2-second long clips from each training video. So, the model is trained with 10 seconds of each video file. Besides, it is also said that Res3D uses only 10 crops.

What I do not understand is whether you extract 8 frames from this five 2-second long clips or this 8 frames are consecutive frames from each video. How many frames are used for each video file? And more importantly, this 8 frames used as input are consecutive frames (or are non-consecutive frames spaced in time)? Before starting to use your model I need to know if this 8 frames are consecutive frames or conversely, they are not consecutive.

Thank you so much for your quick replies!

Best, Rubén