search

Jeff-sjtu / HybrIK

Official code of "HybrIK: A Hybrid Analytical-Neural Inverse Kinematics Solution for 3D Human Pose and Shape Estimation", CVPR 2021
MIT License
1.16k stars 142 forks source link

3D joint locations for mpjpe calculation on custom video using demo script #199

Open pankhurivanjani opened 9 months ago

pankhurivanjani commented 9 months ago

Hello! I run the demo script on the custom videos and I get res.pk file, which has these keys from the code:

res_keys = [
    'pred_uvd',
    'pred_xyz_17',
    'pred_xyz_29',
    'pred_xyz_24_struct',
    'pred_scores',
    'pred_camera',
    # 'f',
    'pred_betas',
    'pred_thetas',
    'pred_phi',
    'pred_cam_root',
    # 'features',
    'transl',
    'transl_camsys',
    'bbox',
    'height',
    'width',
    'img_path'
]

I have some GT 3D joint locations. For MPJPE calculation, can I get the 3D Joint locations directly from this demo script? pred_thetas are 3D joint rotations, do I need to write the code for FK or can I directly get the root relative 3D joint locations?

biansy000 commented 9 months ago

There are some different formats of keypoint representation. pred_xyz_17 are keypoints in Human3.6m format obtained by FK, pred_xyz_24_struct are keypoints in SMPL format obtained by FK, and pred_xyz_29 are keypoints directly predicted by the backbone network. All the three items are root-relative by default.