Hangz-nju-cuhk / Talking-Face_PC-AVS

Code for Pose-Controllable Talking Face Generation by Implicitly Modularized Audio-Visual Representation (CVPR 2021)
Creative Commons Attribution 4.0 International
916 stars 169 forks source link

LRW + VoxCeleb #46

Closed Yingying6 closed 2 years ago

Yingying6 commented 2 years ago

Hi Hang, did you combine the two dataset for training the lip-sync and test separately on each, or did you separate the training dataset - i wonder if voxceleb2 alone can achieve the good performance in terms of the lip-sync. Thanks.

Hangz-nju-cuhk commented 2 years ago

Voxceleb2 alone can already achieve good lip-sync performance. Our model is finetuned on LRW to improve the generation quality.