GuyTevet / motion-diffusion-model

The official PyTorch implementation of the paper "Human Motion Diffusion Model"
MIT License
3.16k stars 347 forks source link

hi, is there a way to using the output animation driven mixamo model? #14

Open lucasjinreal opened 2 years ago

lucasjinreal commented 2 years ago

hi, is there a way to using the output animation driven mixamo model?

the skeleton between smpl and mixamo are not very likely.

GuyTevet commented 2 years ago

Hi @jinfagang ! Indeed that's not a trivial task. Maybe issue #5 will have some useful info in this direction. Anyway, if someone manages to do so, I will be happy if you send us a pull request (and will be listed as a contributor)!

yosun commented 1 year ago

why not smpl to fbx.. or Unity biped rig

lvZic commented 1 year ago

Hi @jinfagang ! Indeed that's not a trivial task. Maybe issue #5 will have some useful info in this direction. Anyway, if someone manages to do so, I will be happy if you send us a pull request (and will be listed as a contributor)!

hi i wonder if there is anyway to cvt SMPL to mixamo model directly in code, except for saving fbx and retargeting?

luoww1992 commented 1 year ago

@lvZic , have you solved it by use smpl pose to drive miximo model ?

lvZic commented 1 year ago

@lvZic , have you solved it by use smpl pose to drive miximo model ?

it is possible to find an eula angle (x, y, z) for each bone, in order to rotate miximo's A pose to SMPL's T pose. Then, the output animation could driven miximo model. In my experiment, most of the animation are accurate after converting.

luoww1992 commented 1 year ago

@lvZic , how to do footskate ?

lvZic commented 1 year ago

@lvZic , how to do footskate ?

The root translation could be estimated by left/right foot movement. Then the sliding problem could be alleviated.

Tigerdwgth commented 3 months ago

After using SMPL2FBX , it becom something like this. What should I do to fix it image

Italian-PAO commented 2 months ago

@lvZic , have you solved it by use smpl pose to drive miximo model ?

it is possible to find an eula angle (x, y, z) for each bone, in order to rotate miximo's A pose to SMPL's T pose. Then, the output animation could driven miximo model. In my experiment, most of the animation are accurate after converting.

@lvZic Hi,I'm now suffering from converting smpl to mixamo model,glad to hear your success. Could you please tell me more about it,or share your converting code?Thanks a lot!

lvZic commented 2 months ago

@lvZic , have you solved it by use smpl pose to drive miximo model ?

it is possible to find an eula angle (x, y, z) for each bone, in order to rotate miximo's A pose to SMPL's T pose. Then, the output animation could driven miximo model. In my experiment, most of the animation are accurate after converting.

@lvZic Hi,I'm now suffering from converting smpl to mixamo model,glad to hear your success. Could you please tell me more about it,or share your converting code?Thanks a lot!

u can try retargeting, and it's easier