search

zhenzhiwang / HumanVid

Official implementation of HumanVid, NeurIPS D&B Track 2024
https://humanvid.github.io/
Creative Commons Attribution 4.0 International
237 stars 2 forks source link

Retargeting motions to Openpose keypoint format #3

Closed julkaztwittera closed 1 month ago

julkaztwittera commented 2 months ago

Hi, fantastic work! I wonder how did you retarget standard motions from Blender/Rokoko to Openpose keypoint format? Haven't found any good solution for this problem.

zhenzhiwang commented 2 months ago

Hi, Currently we have implemented the convertion from SMPL-X 3D skeleton to openpose keypoints, by first projecting the 3D skeleton to 2D skeleton in the camera space and then reorder the keypoints to fit the openpose format. For motion with other format, I think it is standard to convert other motions to SMPL-X format. We will also open-source such code later. Stay tuned!

zhenzhiwang commented 1 month ago

Hi julkaztwittera,

We have released the script to convert 3D SMPL-X keypoints to 2D SMPL-X keypoints in the camera space (from Bedlam repo), and the script to re-organize keypoints to fit the commonly used COCO keypoints for skeleton visualization similar to DWPose's results. Please check the python scripts in this repo.