Jeff-sjtu / HybrIK

Official code of "HybrIK: A Hybrid Analytical-Neural Inverse Kinematics Solution for 3D Human Pose and Shape Estimation", CVPR 2021
MIT License
1.2k stars 146 forks source link

Reconstructed Pose Q from quaternions #82

Open Tengoles opened 2 years ago

Tengoles commented 2 years ago

Hello, first of all I wanted to congratulate the authors for publishing this ground breaking work. I'm currently working on some 3D pose estimation projects and it would be impossible without this framework.

Right now I'm in need of obtaining the reconstructed pose Q from the pose quaternions. According to your paper this can be done using forward kinematics or a regressor. Is there any code available for this task? The paper talks about the procdure but I can't find the code to do it in the repo.

Thanks!

biansy000 commented 2 years ago

If I understand correctly, maybe you can convert quaternions to axis-angle or rotation matrix, and then use the forward function of SMPL.

Holmes-Alan commented 2 years ago

If I understand correctly, maybe you can convert quaternions to axis-angle or rotation matrix, and then use the forward function of SMPL.

How did you convert quaternions to axis-angle or rotation matrix?

Tengoles commented 1 year ago

@Jeff-sjtu The current forward method of SMPL outputs vertices that overall match the original ones (output of processing a frame with HRNet + hybrik) and also gives 24 keypoints. How can I project those keypoints into the original input frame?