Questions about the demo video in project page

Hangz-nju-cuhk / Talking-Face_PC-AVS

Code for Pose-Controllable Talking Face Generation by Implicitly Modularized Audio-Visual Representation (CVPR 2021)

Creative Commons Attribution 4.0 International

916 stars 169 forks source link

Questions about the demo video in project page #39

Closed DaddyJin closed 3 years ago

DaddyJin commented 3 years ago

In the demo video on the project page, there are generated faces of Obama and Biden，of time stamp 2:26. It seems that there exists a little identity mismatch problem, which may be a potential improvement direction. Could you please tell us the source videos you use in this situation or the location in VoxCeleb2(maybe) for better reference? Thanks in advance and appreciate the great work PC-AVS!

Hangz-nju-cuhk commented 3 years ago

Hi, yes indeed there is the identity mismatch problem which I also think is worth exploring.

For generating these videos, we use actually only two photos as identity references as shown before this video. These two photos are directly found on the internet, from their speeches.

DaddyJin commented 3 years ago

Appreciate the reply. Have a good day!