search

google-research / mint

Multi-modal Content Creation Model Training Infrastructure including the FACT model (AI Choreographer) implementation.
Apache License 2.0
497 stars 85 forks source link

Visulization with 3D character #16

Closed EricGuo5513 closed 2 years ago

EricGuo5513 commented 2 years ago

Hi, thanks for your fancy work. I'm new in 3D visualization. Just curious how you visualize the generate 3D motion with character from Mixamo. Do you use blender or something? Could you possibly refer some helpful websites or something like that?

Thanks in advance.

WinstonDeng commented 2 years ago

Same question. Looking forward to the animation script.

Jevin754 commented 2 years ago

+1

NewCoderQ commented 2 years ago

Maybe you need some scripts like this

birdflies commented 2 years ago

+1

shanyang-me commented 2 years ago

We used Blender + AutoRigPro(https://blendermarket.com/products/auto-rig-pro), you could download the Mixamo character (which is the easiest to rig and have corresponding joints with SMPL). Then convert our results to fbx file using the script, then import it into blender.

wang-zm18 commented 2 years ago

Thank you for your shairing!

wang-zm18 commented 2 years ago

@shanyang-me what is your script to convert the SMPL results to fbx files?

shanyangmie commented 2 years ago

@wang-zm18 I have a typo in the previous reply, not fbx but bvh. The conversion tool: https://github.com/google-research/mint/blob/main/tools/bvh_writer.py. You can convert the results to bvh then use blender to import the bvh file.

wang-zm18 commented 2 years ago

OK，Thank you!

h310558606 commented 2 years ago

Could you tell me how to use the bvh_writer.py? The dimension of the model output is 225, I think that this npy file can't be the input of the bvh_writer.py.