search

Hangz-nju-cuhk / Talking-Face_PC-AVS

Code for Pose-Controllable Talking Face Generation by Implicitly Modularized Audio-Visual Representation (CVPR 2021)
Creative Commons Attribution 4.0 International
916 stars 169 forks source link

identity encoder怎么训练的? #51

Open nopeiyu opened 2 years ago

nopeiyu commented 2 years ago

你好,你的论文里提到你在Voxceleb2数据集训练了identity encoder,用来提取pose信息,训练中使用了三种数据增强,能详细说下怎么训练的吗?损失函数怎么定义呢

Hangz-nju-cuhk commented 2 years ago

训练了identity encoder不是用来提取pose信息的。id encoder的训练就是单纯的softmax cross entropy，用voxceleb2的label。