search

torinmb / mediapipe-touchdesigner

GPU Accelerated MediaPipe Plugin for TouchDesigner
MIT License
637 stars 31 forks source link

First Detection of hand is always on the left. #86

Closed foong closed 1 month ago

foong commented 4 months ago

Im having issue where the first instance of a detected hand is always "h1" and always "left hand" regardless if i am using my left or right hand. the second detected hand will always be "h2" and always "right hand"

Screenshot 2024-05-30 at 4 46 43 PM Screenshot 2024-05-30 at 4 46 34 PM
domisjustanumber commented 1 month ago

Hey! Wow sorry it took so long to get back to you. This was an interesting one to dig into - h1 and h2 are simply "first hand detected and second hand detected" - they could be 2 left hands or 2 right hands.

However, MediaPipe does output a score of how confident it is about the detected hand being left or right. I've just added 4 extra channels to the Helpers CHOP that give you the amount of "Rightness" or "Leftness" confidence MediaPipe has for each detected hand.

It'll be in the next release :)

image

domisjustanumber commented 1 month ago

Now released! https://github.com/torinmb/mediapipe-touchdesigner/releases/tag/v0.4.3