creativeIKEP / BlazePoseBarracuda

BlazePoseBarracuda is a human 2D/3D pose estimation neural network that runs the Mediapipe Pose (BlazePose) pipeline on the Unity Barracuda with GPU.
Apache License 2.0
198 stars 31 forks source link

World Landmark Raw Buffer Output #5

Closed sayakbanerjee1999 closed 1 year ago

sayakbanerjee1999 commented 2 years ago

Hey !!!

Just wanted to clarify the way the data is stored in the world landmark raw buffer output in the Pose Landmarker Script

Is it x, y, z for each frame and each point or in any other shape.

Thanks in Advance

creativeIKEP commented 2 years ago

Hi, @sayakbanerjee1999 You can get pose world landmarks from the worldLandmarkBuffer variable after call the ProcessImage method. worldLandmarkBuffer variable is 34 length ComputeBuffer of float4 array type.

0~32 index datas are (x, y, z, score). x, y and z: Real-world 3D coordinates in meters with the origin at the center between hips. score: The score of whether the world landmark position is visible (Range is [0, 1]).

X of 33 index data is the score whether human pose is visible (Range is [0, 1]).

These data is stored per givened texture. So, you can get landmarks each frame if you input a webcam or movies frame to ProcessImage method argument.

Check README.md or "/Assets/Script/PoseVisuallizer3D.cs" about the way get landmarks data.

creativeIKEP commented 1 year ago

I believe this issue is resolved. I close this issue.