TesseraktZero / UnityHandTrackingWithMediapipe

Realtime hand tracking and finger tracking in Unity using Mediapipe
Apache License 2.0
286 stars 66 forks source link

Ask about coordinate conversion #14

Open RICKYLIKEBIRD opened 2 years ago

RICKYLIKEBIRD commented 2 years ago

I know about the output of the mediapipe should be the coordinates of the NDC, how did you convert the output so that it can be used correctly in unity? Or maybe the data uploaded from your mobile phone are already available coordinates?

TesseraktZero commented 2 years ago

Hi Ricky,

The landmark positions from the hand landmark model are 3D coord relative to the wrist. I manually converted the NDC wrist position by calculating the depth based on finger distance.