search

geaxgx / depthai_hand_tracker

Running Google Mediapipe Hand Tracking models on Luxonis DepthAI hardware (OAK-D-lite, OAK-D, OAK-1,...)
MIT License
400 stars 76 forks source link

Use of Depth ? #5

Closed mcoenca closed 2 years ago

mcoenca commented 2 years ago

Hello, Just a question that might lead to a readme improvement.

Are you using in any way the depth sensor to improve the hand tracking ?

Or are your motivations only to port the RGB detection and model of Mediapipe to the RGB + gpu of DepthAI ?

Thanks !

Best,

geaxgx commented 2 years ago

Hi, yes this is mainly the port of Mediapipe hand tracking on RGB frames. The depth sensor is not used to improve the hand tracking, but to get the 3D location of the wrist keypoint, by using the -xyz option in demo.py or the xyz flag in HandTracker class. https://raw.githubusercontent.com/geaxgx/depthai_hand_tracker/main/img/hands_xyz.png