Rudrabha / LipGAN

This repository contains the codes for LipGAN. LipGAN was published as a part of the paper titled "Towards Automatic Face-to-Face Translation".
http://cvit.iiit.ac.in/research/projects/cvit-projects/facetoface-translation
MIT License
578 stars 122 forks source link

About Chin movement #14

Closed chikiuso closed 4 years ago

chikiuso commented 4 years ago

Hi, I see the result that the Chin isn't moving and looks like diecut, may I ask how to make it include the chin movement? thanks.

prajwalkr commented 4 years ago

Could you please post an example video here? The model takes into account the whole face, including the chin.

chikiuso commented 4 years ago

Hi @prajwalkr , it is for you have a look, thanks :

https://dai.ly/x7shvnx

prajwalkr commented 4 years ago

Thanks! I just had a look at it and this is an issue with the face detection which can be easily fixed.

If you look closely you can see that the face is detected only till a particular point and it has excluded the chin. You can correct this by specifying the --pads argument. Please increase the bottom padding to include the chin.

python batch_inference.py --pads 0 --pads 10 --pads 0 --pads 0 --checkpoint_path ....

The above will add a bottom padding of 10 pixels. Change the parameter according to your needs. Refer this line for more info.

chikiuso commented 4 years ago

thanks for your help! your work is really important, and will make the history!