SamsungLabs / DINAR

Inference code for "DINAR: Diffusion Inpainting of Neural Textures for One-Shot Human Avatars"
Other
100 stars 6 forks source link

How to generate a pickle file of a animation sequence? #1

Open ch1998 opened 1 year ago

ch1998 commented 1 year ago

Outstanding paper! May I ask how I will replace the animation sequence, how should I generate a new animation sequence file?

david-svitov commented 1 year ago

Hi! You can use animation sequences from the AMASS Dataset: https://amass.is.tue.mpg.de/ They have SMPL-X animated with motion capture. But you have to reorder the file structure so it matches the current animation sequence. You can do it with python, just make sure the dicts are in the same format.

ch1998 commented 1 year ago

Hi! You can use animation sequences from the AMASS Dataset: https://amass.is.tue.mpg.de/ They have SMPL-X animated with motion capture. But you have to reorder the file structure so it matches the current animation sequence. You can do it with python, just make sure the dicts are in the same format.

Thanks for your reply, I will try it

ch1998 commented 1 year ago

Thanks for your reply, I will try it!

ch1998 commented 1 year ago

Hi! I tried to get the SMPL-X parameters of animation sequences , but in the testseq_azure_amass_merged_poses.pickle you gave, there is a K, and the shape of K is (3, 3). What does this parameter mean? camera parameters?

david-svitov commented 1 year ago

@ch1998 Yes, it is camera parameters. But as you can see in video_maker.py we don't really use them, so it shouldn't be a big problem.