google-research / mint

Multi-modal Content Creation Model Training Infrastructure including the FACT model (AI Choreographer) implementation.
Apache License 2.0
497 stars 85 forks source link

Can you explain why dimension of model output is 225, and dimension of SMPL skeleton is 24*3 ? #54

Open garspace opened 2 years ago

garspace commented 2 years ago

I want to convert pkl of output to character animation, but the dimension is not matched, how can i do that?

CuberFan commented 2 years ago

I want to convert pkl of output to character animation, but the dimension is not matched, how can i do that?

225 = 6pad + 3trans + 216pose

216pose=24x9=24x3x3

24x3---->24x9

godkath commented 2 years ago

why 24*9

CuberFan commented 2 years ago

why 24*9

scipy.spatial.transform.Rotation.from_rotvec: 24x3------>24x9

pjgalhardo commented 2 years ago

225 = 6pad + 3trans + 216pose

@CuberFan pad as in padding? If so, why do you need padding here?

Exuan148 commented 1 year ago

why 24*9

the size of rotation matrix is 3*3