luxonis / depthai

DepthAI Python API utilities, examples, and tutorials.
https://docs.luxonis.com
MIT License
946 stars 234 forks source link

Motion Estimation #245

Open Luxonis-Brandon opened 4 years ago

Luxonis-Brandon commented 4 years ago

Start with the why:

In many CV/AI pipelines it is advantageous to seed the pipeline or inform the pipeline based on where there is motion in the scene and the DepthAI hardware has built-in hardware acceleration for motion estimation.

Move to the how:

Leverage the Gen2 Pipeline Builder architecture https://github.com/luxonis/depthai/issues/136 to implement motion estimation as a node in the pipeline (including operating directly on the camera feeds) which returns pixel locations of motion.

Move to the what:

Implement hardware accelerated motion estimation in the Gen2 DepthAI API.

Erol444 commented 2 years ago

Demo of computing difference of 2 consecutive frames with a custom NN model can be found here.

diff-demo