Track Head Pose (xyz+rpy)

[tfvieira]

TODO

• [x] Track head pose.
• [x] Improve virtual scene.

References

• MediaPipe-Face-Mesh metric-3d.
• Face landmark detection guide.
• A Simple and efficient Face direction detection in React.

Videos

• Testing Head Pose Estimation with Mediapipe.
• Testing Head Tracking with MediaPipe and A-frame.

Papers

• Hands-Free Human–Robot Interaction Using Multimodal Gestures and Deep Learning in Wearable Mixed Reality (2021).
• High Fidelity Motion Adaptive Face Reenactment (2022) -- Forçando um pouco a barra.

[vannisson]

Achei umas coisas interessantes, esse Opentrack é um software que aplica isso que estamos fazendo, só que com o foco em jogos:

• https://github.com/opentrack/opentrack
• https://github.com/AIRLegend/aitrack
• https://www.youtube.com/watch?v=NS7sqcuEcZ0