search

svip-lab / impersonator

PyTorch implementation of our ICCV 2019 paper: Liquid Warping GAN: A Unified Framework for Human Motion Imitation, Appearance Transfer and Novel View Synthesis
https://svip-lab.github.io/project/impersonator
Other
1.73k stars 318 forks source link

How to create kps.pkl and pose_shape.pkl #49

Open sondv2 opened 4 years ago

sondv2 commented 4 years ago

How do you generate this file ?

Thanks

darkAlert commented 4 years ago

pose_shape.pkl is a SMPL-model You can get it using HMR/VIBE

AmberCheng commented 3 years ago

pose_shape.pkl is a SMPL-model You can get it using HMR/VIBE

hi, I wonder have you ever tried VIBE. I am confused when I use the VIBE result, then I generate images with the source person rotating up and down. I wonder do you have any idea about it.

piaozhx commented 3 years ago

@AmberCheng Hi, could you provide some examples about this problem (VIBE data or synthesis results)?

AmberCheng commented 3 years ago

@AmberCheng Hi, could you provide some examples about this problem (VIBE data or synthesis results)?

I just use the demo result of VIBE which I have attached. I just use the inference_from_smpl function. I am not sure is there any problem with my usage. One more, I tried to replace one more parameter verts, the result is without spinning, but it is not good that some frames don't contain the whole body.

I find that the video I generated trembled, is there could be any improvement with the HMR network(maybe it doesn't detect the human mesh precisely enough)?

Looking for your reply~

vibe_output.pkl.zip

piaozhx commented 3 years ago

@AmberCheng Hi, I try to open this pkl file but it seems to be broken

ValueError: unregistered extension code 30855

and as your description, you have tried HMR and VIBE to extract SMPL parameters, and HMR results were not good but the synthesis result is "normal", but parameters from VIBE had wrong rotation(rotating up and down).

actually I have nerver used VIBE so I do not know whether the definition between HMR and VIBE are same or not, but I think they can transfer to each other

AmberCheng commented 3 years ago

@AmberCheng Hi, I try to open this pkl file but it seems to be broken

ValueError: unregistered extension code 30855

and as your description, you have tried HMR and VIBE to extract SMPL parameters, and HMR results were not good but the synthesis result is "normal", but parameters from VIBE had wrong rotation(rotating up and down).

actually I have never used VIBE so I do not know whether the definition between HMR and VIBE are same or not, but I think they can transfer to each other

@piaozhx Thanks for your replay. Actually, I have solved this problem recently. HMR and VIBE are using different render methods. VIBE uses 4 dimension params for the original camera params which different from the HMR. So when I only use the VIBE pose parameters, it works but as the difference between camera parameters, it seems like the person suddenly far suddenly near. I think there may be something that needs to do with the camera parameters.