search

lisiyao21 / Bailando

Code for CVPR 2022 paper "Bailando: 3D dance generation via Actor-Critic GPT with Choreographic Memory"
Other
382 stars 59 forks source link

Can you explain dimension of actor model output is 72 which means skeleton rotation or position without root offset(Hips or pelvis)? #23

Open garspace opened 2 years ago

garspace commented 2 years ago

I want to generate character animation, how can I do?

lisiyao21 commented 2 years ago

Hi, thank you for your interest!

To drive character animation, you need to transfer 3D joint keypoints to rotation matrix/eular angles (this step is called "inverse kinemetics", IK), save them into some format like .fbx and render the character using CG softwares like Blender. The IK step was implemented in SenseTime (a company) with Unity software, which is not for open source.

We realize that the public is willing to have a one for avatar in a simpler way. We will try to train and release a "rotmat" version in few months.

aleeyangfu commented 2 years ago

I want to generate character animation, how can I do?

have you done it? Have you try transform the output pose(T*72) to bvh file(which can render mode in blender?)

hunting777 commented 1 year ago

have you done it? Have you train and release a "rotmat" version ?

vick7y commented 1 year ago

Most of the bvh and fbx transform tools I found online requires a smpl trans input. Has anyone succeeded in using their output (T*72) to generate an fbx or bvh that actually works?

wiibrew commented 8 months ago

Most of the bvh and fbx transform tools I found online requires a smpl trans input. Has anyone succeeded in using their output (T*72) to generate an fbx or bvh that actually works?

Hey, I just come across your question today, want to share that this piece of code can generate usebale bvh, https://github.com/KosukeFukazawa/smpl2bvh/blob/main/smpl2bvh.py I think the author didn't fully finish the implementation but the code is strightforward to show the format of bvh and provide a template for editting. Best