mingyuan-zhang / MotionDiffuse

MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Model
https://mingyuan-zhang.github.io/projects/MotionDiffuse.html
Other
835 stars 74 forks source link

How to implement SMPL skin model? #27

Closed fyyakaxyy closed 1 year ago

fyyakaxyy commented 1 year ago

Hello

First of all thank you very much for posting this repository.

The result of my reproduction is a skeleton model of the human body, how should the SMPL skin model shown in your project be realized?

Thanks in advance

mingyuan-zhang commented 1 year ago

Hi, you may use mmhuman3d to convert 3D keypoints sequences to SMPL sequences. Then you can use SMPL Blender Addon to generate visualization results.

fyyakaxyy commented 1 year ago

Thank you very much for your answer. With your help, my problem has been solved!

hbkang-slx commented 1 year ago

Thank you very much for your answer. With your help, my problem has been solved!

mmhuman3d doesn't provide keypoints conversion between humanml3d keypoints and smpl. Can you explain how you solved it?

hbkang-slx commented 1 year ago

Hi, you may use mmhuman3d to convert 3D keypoints sequences to SMPL sequences. Then you can use SMPL Blender Addon to generate visualization results.

What functions do I have to use to generate SMPL pose sequences? MMhuman3d doesn't seem to provide a keypoints to pose conversion function.

fyyakaxyy commented 1 year ago

Thank you very much for your answer. With your help, my problem has been solved!

mmhuman3d doesn't provide keypoints conversion between humanml3d keypoints and smpl. Can you explain how you solved it?

joint2smpl and blender

hbkang-slx commented 1 year ago

The SMPL-addon doesn't seem to support importing pose files, and the SMPL-X addon keeps returning errors when importing pose.pkl files and animation.npy/npz files. Is manually coding a solution to import the pose information into Blender required?