Can I use this model for video classification?

titu1994 / keras-non-local-nets

Keras implementation of Non-local Neural Networks

MIT License

290 stars 100 forks source link

Can I use this model for video classification? #11

Open ZhangLin-PKU opened 5 years ago

ZhangLin-PKU commented 5 years ago

@titu1994 Thank you for your code! I want to use the non-local resnet model for video classification, as in the paper. The author emphasizes that the convolution operation should be 3-d convolution, but I can't see it in your nonlocal_resnet.py file. So I think this model doesn't fit video classification task, am I right?

titu1994 commented 5 years ago

The non_local block itself supports all types of convolutions, however you would need to write the 3d ResNet variant to actually use it.

momo1986 commented 5 years ago

Hello, @titu1994 ,for non-local-resnet in 3D version, should I replace the previous 2D version with 3D blocks like Conv and Pooling? Thanks & regards!

titu1994 commented 5 years ago

Yup that's should be sufficient.