search

zhanglonghao1992 / One-Shot_Free-View_Neural_Talking_Head_Synthesis

Pytorch implementation of paper "One-Shot Free-View Neural Talking-Head Synthesis for Video Conferencing"
Other
735 stars 141 forks source link

Unstable training results #74

Closed Turlan closed 1 year ago

Turlan commented 1 year ago

Thanks for your implementation! I found something weird when using this training script, I hope u can help me to fix this problem. I added test scripts during training to better visualize the training process. However, I found that the model could totally fail for some certain test cases shown as follows: image image while perform normally for others: image image

And for the failed cases, the results are not getting better for further training. Is it normal? Have u ever met such similar circumstances?

Turlan commented 1 year ago

By the way, the training set is changed to vox2 in this training.

Turlan commented 1 year ago

Further training will alleviate this phenomenon.