HongwenZhang / PyMAF-X

[TPAMI 2023] PyMAF-X: Towards Well-aligned Full-body Model Regression from Monocular Images
https://www.liuyebin.com/pymaf-x
Other
196 stars 27 forks source link

How to load the hand poses into the blender SMPLX add-on correctly? #14

Open alexluo-netizen opened 1 year ago

alexluo-netizen commented 1 year ago

Hi, thanks for your great work. I tried your codes and it works well on body pose, expression and the general shape! However I still got some questions regarding the hand poses and the possible missed use parameters.

I tried to revise the generated '.pkl' file from the PYMAFX to make it aligned to be loaded into the SMPLX blender add on. (The reference dataset I used is AGORA sample data, which can be easily loaded into SMPLX blender add on.) As you adviced in the previous issue that selecting 21 bones from 24 SMPL bones, I selected 63 from the 72 body poses. However, not like the 'body_pose', hand poses are stored in the key 'smplx_params' and they have different shapes than the SMPLX blender adds on requires. I tried to convert the hand pose with shape torch.Size([1, 15, 3, 3]) to shape (1,45) by the method of converting rotation matrix to euler angle but it didn't work. The fingers of the mesh often keeps holding as fist and don't move well enough. So far I have added 9 parameters in my pkl file, which are 'body_pose', 'betas', 'global_trans', 'left_hand_pose', right_hand_pose', 'jaw_pose', 'leye_pose', 'reye_pose' and 'expression'. Could you give me a hint that which parameters are possibly missed here?

oijoijcoiejoijce commented 1 year ago

+1

Darius-H commented 1 year ago

Have you solved this problem? I have trouble in reading smplx_params from .pkl file with smpl.SMPLX model.

Hi, thanks for your great work. I tried your codes and it works well on body pose, expression and the general shape! However I still got some questions regarding the hand poses and the possible missed use parameters.

I tried to revise the generated '.pkl' file from the PYMAFX to make it aligned to be loaded into the SMPLX blender add on. (The reference dataset I used is AGORA sample data, which can be easily loaded into SMPLX blender add on.) As you adviced in the previous issue that selecting 21 bones from 24 SMPL bones, I selected 63 from the 72 body poses. However, not like the 'body_pose', hand poses are stored in the key 'smplx_params' and they have different shapes than the SMPLX blender adds on requires. I tried to convert the hand pose with shape torch.Size([1, 15, 3, 3]) to shape (1,45) by the method of converting rotation matrix to euler angle but it didn't work. The fingers of the mesh often keeps holding as fist and don't move well enough. So far I have added 9 parameters in my pkl file, which are 'body_pose', 'betas', 'global_trans', 'left_hand_pose', right_hand_pose', 'jaw_pose', 'leye_pose', 'reye_pose' and 'expression'. Could you give me a hint that which parameters are possibly missed here?

AWangji commented 7 months ago

h smpl.SMPLX model.

Hi, I met some errors when importing pkl file in blender. image

I want to know what blender addon do you use? or how do you resolve it. Thanks this is what I use: image