google-ai-edge / mediapipe

Cross-platform, customizable ML solutions for live and streaming media.
https://mediapipe.dev
Apache License 2.0
26.77k stars 5.09k forks source link

How is the depth information of the model calculated #4867

Open Skullface9512 opened 11 months ago

Skullface9512 commented 11 months ago

Have I written custom code (as opposed to using a stock example script provided in MediaPipe)

Yes

OS Platform and Distribution

Ubuntu16.04

MediaPipe version

No response

Bazel version

No response

Solution

HangLandmark

Programming Language and version

Python

Describe the actual behavior

No response

Describe the expected behaviour

No response

Standalone code/steps you may have used to try to get what you need

I read the paper of MediaPipe Hands: On-device Real-time Hand Tracking, but the caluation way of depth value is not described, so i feel confused.

Other info / Complete Logs

No response

kuaashish commented 11 months ago

@Skullface9512,

Could you kindly provide a more detailed explanation of your inquiry, including the specific steps you are following as outlined in the documentation? Additionally, please specify the comprehensive support you are seeking from us. Thank you

Skullface9512 commented 11 months ago

The output of MediaPipe includes the two-dimensional coordinates of the key points and the corresponding depth value. The paper says that the depth value is based on the wrist joint, but it does not list the specific calculation formula for the depth value. Therefore, I do not understand how to calculate the corresponding depth value through the three coordinates of the key points in the process of making labels, thank you for answering my question.

发自我的iPhone

------------------ Original ------------------ From: kuaashish @.> Date: Wed,Oct 11,2023 6:50 PM To: google/mediapipe @.> Cc: Skullface9512 @.>, Mention @.> Subject: Re: [google/mediapipe] How is the depth information of the modelcalculated (Issue #4867)

@Skullface9512,

Could you kindly provide a more detailed explanation of your inquiry, including the specific steps you are following as outlined in the documentation? Additionally, please specify the comprehensive support you are seeking from us. Thank you

— Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you were mentioned.Message ID: @.***>