vchoutas / expose

ExPose - EXpressive POse and Shape rEgression
Other
617 stars 100 forks source link

how to read param.npz result from demo.py #63

Open enrico310786 opened 1 year ago

enrico310786 commented 1 year ago

Hi, i run the script demo.py. Among the results, in addition to the .ply files, there is a .npz file. This contains a lot of information, including body_pose,left_hand_pose,right_hand_pose,jaw_pose,betas,expression,vertices,joints,full_pose,transl,v_shaped,proj_joints,shift_x,shift_y,focal_length_in_mm,focal_length_in_px,center,sensor_width.

Taking for example left_hand_pose, i can see the following coordinates

[[[ 7.7151352e-01 6.2732607e-01 1.0596585e-01] [-6.0104364e-01 7.7329415e-01 -2.0189776e-01] [-2.0859851e-01 9.2076764e-02 9.7365725e-01]]

[[ 3.5163164e-01 9.3468720e-01 -5.2106757e-02] [-9.3588984e-01 3.4971061e-01 -4.2575989e-02] [-2.1572944e-02 6.3737251e-02 9.9773359e-01]]

[[ 9.3272626e-01 3.3996129e-01 -1.2020016e-01] [-3.3708388e-01 9.4043922e-01 4.4142537e-02] [ 1.2804769e-01 -6.5536634e-04 9.9176782e-01]]

etc etc etc.

Is there any way to know which keypoint each coordinate refers to for each kind of poses? In which unit of measurement are the coordinates expressed (mm, px)? I would like to reconstruct the whole skeleton and its 3D keypoints. In this case, what are the keypoints of the skeleton?

Thanks