google-research / mint

Multi-modal Content Creation Model Training Infrastructure including the FACT model (AI Choreographer) implementation.
Apache License 2.0
497 stars 85 forks source link

Can mint support the smpl scale prediction? #30

Open youngstu opened 2 years ago

youngstu commented 2 years ago

Can mint support the smpl scale prediction? Code shows that mint doesn't support smpl scale prediction, but the official demo has diffierent scales (different distance).

https://google.github.io/aichoreographer/assets/gen_results_8.mp4

liruilong940607 commented 2 years ago

The code does support the translation --> the scale differences in the image plan is actually caused by the 3D translation in the world space.