search

statho / ScoreHMR

ScoreHMR: Score-Guided Diffusion for 3D Human Recovery (CVPR 2024)
MIT License
385 stars 25 forks source link

3D Keypoint data? #10

Closed mattrencher closed 6 months ago

mattrencher commented 6 months ago

Hi, Can 3D keypoint data be returned in json format from images and videos? Only see 2d keypoints return from images and videos using the demo scripts. TIA

statho commented 6 months ago

You can get the 3D keypoints as smpl_out.joints, where smpl_out is the output of the SMPL model (see here for an example).

wclincke commented 5 months ago

Hi, After extracting 3D keypoints from images, I'm looking to visualize them as a skeleton overlay on the images. Could you point me toward resources or documentation that explain the 3D keypoints to skeleton point mappings? Thanks for your help!

statho commented 5 months ago

The definition for the 3D keypoints can be found here.

To visualize the keypoints you can project them onto an image, using this function.

You can take a look at the SkeletonRenderer class here. This class is used during training to create tensorboard visualizations (also creates visuals for the ground-truth 2D and 3D keypoints). Only the 25 OpenPose joints are used for vizualization.

wclincke commented 5 months ago

Is this the initial set of 24 points from the smpl_out.joints output? It seems that this output provides 44 3D data points.