Feature Extraction for videos in real time

facebookresearch / VMZ

VMZ: Model Zoo for Video Modeling

Apache License 2.0

1.04k stars 156 forks source link

Feature Extraction for videos in real time #59

Closed nerdykamil closed 5 years ago

nerdykamil commented 5 years ago

Hey, thank you for the great work. I was able to extract features through feature extraction script and train model using those features. I was wondering how can I tweak this script to get features of video in real time, as what could be the list file in that case.

dutran commented 5 years ago

Currently that script uses VideoInputOp that need to run by mini-batch. Alternatively, you can write a simple video loader (using python opencv or something similar python ffmpeg) to read video from file or live webcam/camera, then preprocess (scale, crop, normalize), then feed them to the workflow for inference only. I wish I can do this when I have time. So this is in my wish list, since it will make a good live demo. cc: @HengCV @CHJoanna

keunhong commented 5 years ago

Could you clarify how the inputs are normalized during training? Are the inputs between -1 and +1?