chungyiweng / humannerf

HumanNeRF turns a monocular video of moving people into a 360 free-viewpoint video.
MIT License
786 stars 86 forks source link

draw skeletons / keypoints in humannerf #63

Closed Dipankar1997161 closed 1 year ago

Dipankar1997161 commented 1 year ago

hello @chungyiweng

I just wanted to know, that during the rendering process, the images are generated, is it possible to generate skeleton or mark the keypoints on those images? If yes, which values need to be considered?

the mesh_info.pkl file consists of the "joints" per frame and we also have the camera parameters from camera.pkl file, do we need to combine both?

Keypoints 2D = projection matrix @ (joints 3D)

However, these 3Djoints are from the smpl parameters, So are they really going to be used for plotting the 2d keypoints onto the image., Also the projection matrix will be made with the actual K R and T or K Rh and Th.

or is there any other way or paper you guys developed which can clarify this? If it is developed within this repo, It will be great.

Kindly respond, so I can move forward with my project