google-research / mint

Multi-modal Content Creation Model Training Infrastructure including the FACT model (AI Choreographer) implementation.
Apache License 2.0
497 stars 85 forks source link

How to transfer .npy file to video #19

Closed loserZhang closed 2 years ago

loserZhang commented 2 years ago

Thanks for your fancy work. I run evaluator.py file and the output file is .npy. Could you please give me some suggestions about transferring the output file to video?

shanyang-me commented 2 years ago

You would need to convert it to fbx suppose you want to use Blender to render out the animation.

loserZhang commented 2 years ago

Yes, is there any way to convert it to fbx? thanks.

heheal commented 2 years ago

Yes, is there any way to convert it to fbx? thanks.

I also want a way to convert it to fbx. Is there a way to solve it?

shanyang-me commented 2 years ago

You can use our bvh converter: https://github.com/google-research/mint/blob/main/tools/bvh_writer.py to convert the npy file into a bvh file. bvh is a format for motion caption. You can import the bvh file into Blender. Then transfer the motion onto your rigged character, then render it as images.

heheal commented 2 years ago

You can use our bvh converter: https://github.com/google-research/mint/blob/main/tools/bvh_writer.py to convert the npy file into a bvh file. bvh is a format for motion caption. You can import the bvh file into Blender. Then transfer the motion onto your rigged character, then render it as images.

Thank you so much.

loserZhang commented 2 years ago

You would need to convert it to fbx suppose you want to use Blender to render out the animation.

You can use our bvh converter: https://github.com/google-research/mint/blob/main/tools/bvh_writer.py to convert the npy file into a bvh file. bvh is a format for motion caption. You can import the bvh file into Blender. Then transfer the motion onto your rigged character, then render it as images.

Thank you so much

jason870509 commented 2 years ago

Thank you so much

Hi. Did you success to transfer the file? Where can I get the 'skeleton_csv_filename'? Thanks!

shanyang-me commented 2 years ago

You would need to get the skeleton_csv_filename from the SMPL skeleton, I forgot to release it and now I'm no longer with Google.

birdflies commented 2 years ago

@jason870509 Hi, do you solve this problem?

jason870509 commented 2 years ago

@jason870509 Hi, do you solve this problem?

No, I still can't solve it. But if you only want to demo your .npy motion, maybe you can refer https://github.com/yanch2116/CharacterDriven-BlenderAddon

wang-zm18 commented 2 years ago

Thank you @jason870509 ! I also met with this "npy -> vbh" problem.

birdflies commented 2 years ago

@jason870509 Hi, do you solve this problem?

No, I still can't solve it. But if you only want to demo your .npy motion, maybe you can refer https://github.com/yanch2116/CharacterDriven-BlenderAddon

Thank you.

h310558606 commented 2 years ago

Did anyone solved the problem?

hzy-del commented 1 year ago

@jason870509 Hi, do you solve this problem?

No, I still can't solve it. But if you only want to demo your .npy motion, maybe you can refer https://github.com/yanch2116/CharacterDriven-BlenderAddon

how npy file use this?

jason870509 commented 1 year ago

how npy file use this?

It appears that the author is no longer maintaining and has removed this project. Perhaps you should seek alternative ways to solve this issue.