search

google-ai-edge / mediapipe

Cross-platform, customizable ML solutions for live and streaming media.
https://ai.google.dev/edge/mediapipe
Apache License 2.0
27.48k stars 5.15k forks source link

How is the coordinate center (hip center) determined if the hip is out of the camera's field of view? #4935

Open NRMOOLY opened 1 year ago

NRMOOLY commented 1 year ago

Have I written custom code (as opposed to using a stock example script provided in MediaPipe)

No

OS Platform and Distribution

Linux ubuntu 20.04

MediaPipe Tasks SDK version

No response

Task name (e.g. Image classification, Gesture recognition etc.)

Detecting pose

Programming Language and version (e.g. C++, Python, Java)

Python

Describe the actual behavior

The code determines the location of the hand relative to the middle of the thigh, but the thigh itself is not in the camera's field of view. How and how accurately are the coordinates calculated?

Describe the expected behaviour

It seems to me that if the hips do not fall into the camera's field of view, the coordinates should count from another center (the middle of the shoulders or nose), depending on what is in the camera's field of view.

Standalone code/steps you may have used to try to get what you need

The program code is standard for example https://github.com/google/mediapipe/issues/4681

Other info / Complete Logs

No response

schmidt-sebastian commented 11 months ago

@yichunk Can you provide an answer here?