iPERDance / iPERCore

Liquid Warping GAN with Attention: A Unified Framework for Human Image Synthesis
https://iperdance.github.io/work/impersonator-plus-plus.html
Apache License 2.0
2.42k stars 311 forks source link

Can it use to transfer half person pose? #51

Closed AmberCheng closed 3 years ago

AmberCheng commented 3 years ago

Hi, thanks for your wonderful work. I wonder does it work for half body pose transfer ?

StevenLiuWen commented 3 years ago

Hi @AmberCheng, currently, half body inputs will produce bad results.

AmberCheng commented 3 years ago

Hi @AmberCheng, currently, half body inputs will produce bad results.

@StevenLiuWen I have ever tried half body in impersonator project(you provide before). I wonder does it because the HMR will give a squat pose for half body?

StevenLiuWen commented 3 years ago

Hi @AmberCheng, currently, half body inputs will produce bad results.

@StevenLiuWen I have ever tried half body in impersonator project(you provide before). I wonder does it because the HMR will give a squat pose for half body?

Yes, you are right. Our project relies on a Mesh Recovery Module (HMR or SPIN), and both of them failed on the half body inputs.

AmberCheng commented 3 years ago

Hi @AmberCheng, currently, half body inputs will produce bad results.

@StevenLiuWen I have ever tried half body in impersonator project(you provide before). I wonder does it because the HMR will give a squat pose for half body?

Yes, you are right. Our project relies on a Mesh Recovery Module (HMR or SPIN), and both of them failed on the half body inputs.

I wonder does it possible to replace Mesh Recovery Module with other method, such as VIBE?

StevenLiuWen commented 3 years ago

Hi @AmberCheng, currently, half body inputs will produce bad results.

@StevenLiuWen I have ever tried half body in impersonator project(you provide before). I wonder does it because the HMR will give a squat pose for half body?

Yes, you are right. Our project relies on a Mesh Recovery Module (HMR or SPIN), and both of them failed on the half body inputs.

I wonder does it possible to replace Mesh Recovery Module with other method, such as VIBE?

Maybe it is possible, we have not tested the half body inputs on the VIBE or other methods yet. If you find it works for the half body inputs, please notify us (thanks first), and we will update the pose 3d estimator with that kind of method.

AmberCheng commented 3 years ago

Hi @AmberCheng, currently, half body inputs will produce bad results.

@StevenLiuWen I have ever tried half body in impersonator project(you provide before). I wonder does it because the HMR will give a squat pose for half body?

Yes, you are right. Our project relies on a Mesh Recovery Module (HMR or SPIN), and both of them failed on the half body inputs.

I wonder does it possible to replace Mesh Recovery Module with other method, such as VIBE?

Maybe it is possible, we have not tested the half body inputs on the VIBE or other methods yet. If you find it works for the half body inputs, please notify us (thanks first), and we will update the pose 3d estimator with that kind of method.

Ok, thanks again for your kind reply~~