search

facebookresearch / pytorchvideo

A deep learning library for video understanding research.
https://pytorchvideo.org/
Apache License 2.0
3.22k stars 395 forks source link

Real Time Video? #57

Open DaveXanatos opened 3 years ago

DaveXanatos commented 3 years ago

I would like to use this on real-time video rather than video files. Possible?

Mathuran-Mang commented 3 years ago

Same question

liyilui commented 3 years ago

similar question as this. Currently, we support real-time video running on mobile phone (see here), and you can replace model there. Will that be good for your use case, or you will also need webcam real time video on PC?

DaveXanatos commented 3 years ago

My use case is embodied autonomous humanoid robots with cameras in their eyeballs, so... would need to be webcam style (it's actually streamed frames going over the robots' internal network via ZeroMQ to allow multiple scripts to operate on the live real-time video.) Most everything is operating in Python with some C++ where Python hasn't the speed. Everything is in a Linux environment. I'll also look more into what I see at #42 - wondering if the database of vids is in vertical orientation? The robot eyeballs cams are 1920x1080, deres'd down to 600 wide for downstream scripts (like face recognition, etc.) All info appreciated, this looks very promising.