google-ai-edge / mediapipe

Cross-platform, customizable ML solutions for live and streaming media.
https://ai.google.dev/edge/mediapipe
Apache License 2.0
27.64k stars 5.17k forks source link

Hand Detection, found two hand, but how to Distinguish it? #706

Closed tristsesame closed 4 years ago

tristsesame commented 4 years ago

multi hand tracking is useful, but it slow, only 15fps in my device. so I have to use the hand detect.

I need draw the hand move path by the hand pos. but if there is two hand, I can't identify the (x,y) belong to which hand? ios/android

mgyong commented 4 years ago

Next version of the hand example will provide differentiation between left and right hand

mgyong commented 4 years ago

@tristsesame We have updated the MediaPipe hands model to include right left prediction https://github.com/google/mediapipe/releases/tag/v0.7.5

tristsesame commented 4 years ago

@tristsesame We have updated the MediaPipe hands model to include right left prediction https://github.com/google/mediapipe/releases/tag/v0.7.5

thank you!

by the way, does the hand detection can have the feature? I think that might be difficult.

fanzhanggoogle commented 4 years ago

Yeah, unfortunately it'll be difficult to support that in the detector.

vasanthhr commented 4 years ago

Hello, (sorry I am asking this question again here as well).

I want to see the prediction left or right hand in the handpose model(tfjs-model: handpose model).

As of now i can see 21 3d keypoints as output, please suggest me how to predict left or right hand on this handpose model.

vivi90 commented 4 years ago

@fanzhanggoogle Two hand support like here described would be great: https://github.com/google/mediapipe/issues/89 Seems to be still not available at the web demo.

M-Ali-ML commented 2 years ago

Have this issue been solved? AFAIK I can't differentiate between left and right hand landmarks.

tso996 commented 2 years ago

It is possible. I'm not sure if it is easy though. From the results object in their examples results = hands.process(image) Try exploring results.multi_handedness Also check out this repo, https://github.com/Kazuhito00/hand-gesture-recognition-using-mediapipe .

janaki112 commented 1 year ago

@tso996 , Hey can you please tell me whether mediapipe recognises gestures involving two hands. As of now it's only detecting left and hand gestures separately. Is it possible to detect gestures involving two hands by performing classification.