facebookresearch / frankmocap

A Strong and Easy-to-use Single View 3D Hand+Body Pose Estimator
Other
2.14k stars 374 forks source link

How can I match hand joints to smplx joint? #200

Closed taewhankim closed 2 years ago

taewhankim commented 2 years ago

Thanks for sharing great project!

I'm studying alone in 3d Human field and less information that I have currently. I want to apply your hand model to my smplx model

  1. Could I simply use pred_hand_pose in pred_hand_list to input into smplx model's fro parameters in my project? or do I need to change the rotation(wrist global rotation)?

https://github.com/facebookresearch/frankmocap/blob/bb05b851bc3f1e27a55fd15e9f46093e7c05fc12/handmocap/hand_mocap_api.py#L228

  1. In this project I have 21 hand positions, but to get smplx output I need to input 15 joints for each hand, I don't know how to do it well.

https://github.com/facebookresearch/frankmocap/blob/bb05b851bc3f1e27a55fd15e9f46093e7c05fc12/integration/copy_and_paste.py#L134

So, How can correspondence between the hand joint points and the smplx model? and where are the other 6 parts used? only for 3d rendering?

3. Another question is hand_pose shape is (1,45) but I want to convert the rotation matrix from rotation 6d to (n,Joints,3,3) format. I would appreciate it if you could tell me how to solve it