Real-time head pose estimation

elucideye / drishti

Real time eye tracking for embedded and mobile devices.

BSD 3-Clause "New" or "Revised" License

392 stars 82 forks source link

Real-time head pose estimation #374

Open headupinclouds opened 7 years ago

headupinclouds commented 7 years ago

Simple PNP (good enough?) https://github.com/royshil/HeadPosePnP
Benchmark + optimize EOS for real time use (every N frames?)

headupinclouds commented 7 years ago

Need to benchmark EOS methods to see what can run feasibly on mobile devices. TODO: investigate better approaches to retrofit 3d eye models to mesh from 2d landmarks. gaze_0 gaze_1

headupinclouds commented 7 years ago

Use a model based approach to estimate ground truth from landmarks and then solve for pose as part of the cascaded pose regression. Various representations are possible for 3 DOF rotation:

http://imd.naist.jp/imdweb/pub/harada_fcv10/paper.pdf

We have shown experimental results of comparison of pose representations for global appearance-based pose estimation of an object.