caizhongang / SMPLer-X

Official Code for "SMPLer-X: Scaling Up Expressive Human Pose and Shape Estimation"
https://caizhongang.github.io/projects/SMPLer-X/
Other
1.02k stars 73 forks source link

How to directly output the BVH file? #29

Open AWangji opened 1 year ago

AWangji commented 1 year ago

Hi, thanks for your great work. As in README, we can get the obj file and the mesh jpg. But my goal is to obtain the BVH file which contains the pose keypoints. We know our project should have the step that extract the pose keypoints like: image So what should we do if we want the BVH file?

ziyuanding commented 1 year ago

Hi @AWangji , if you want keypoints like what in your screenshots, joint_projis the thing you want. after some transformation, you can overlay these joints on the final output images, code could be found here: image

if you want 3d joint data, please find joint_cam.

if you want to view the animation quickly in tools like blender, please see this comment: https://github.com/caizhongang/SMPLer-X/issues/20#issuecomment-1811879336 , I think you may get bvh based on this comment.

AWangji commented 11 months ago

你好@AWangji, 如果您想要像屏幕截图中那样的关键点,joint_proj那就是您想要的。经过一些转换后,您可以将这些关节叠加在最终的输出图像上,代码可以在这里找到: 图像

如果您想要 3D 关节数据,请查找joint_cam.

如果你想在blender等工具中快速查看动画,请看这条评论:#20(评论),我想你可能会根据这条评论得到bvh。

hi, thanks for your help, now I can output a FBX file with both mesh and skeleton. But there is still a question: using this way will lose the hand finger details, like: image The fingers movements never change

zxx123518 commented 8 months ago

你好@AWangji, 如果您想要像屏幕截图中那样的关键点,joint_proj那就是您想要的。经过一些转换后,您可以将这些关节叠加在最终的输出图像上,代码可以在这里找到: 图像 如果您想要 3D 关节数据,请查找joint_cam. 如果你想在blender等工具中快速查看动画,请看这条评论:#20(评论),我想你可能会根据这条评论得到bvh。

hi, thanks for your help, now I can output a FBX file with both mesh and skeleton. But there is still a question: using this way will lose the hand finger details, like: image The fingers movements never change

Hello, I am also studying BVH export problem at present, could you share the code related to your movement output? Thank you very much!