search

zhanglonghao1992 / One-Shot_Free-View_Neural_Talking_Head_Synthesis

Pytorch implementation of paper "One-Shot Free-View Neural Talking-Head Synthesis for Video Conferencing"
Other
735 stars 141 forks source link

Using jacobians or rotation matrix for warping features #59

Open ghost opened 2 years ago

ghost commented 2 years ago

Hi @zhanglonghao1992 , Thanks for sharing your implementation of the paper!

As I understand there is difference from the first to the last version of the paper regarding the using of the jacobians as part of the feature deformation- the jacobians are replaced with the rotation matrices of the source and the driving. I see in lines 50-60 of your implementation to the dense motion model that you comment the use of the rotation matrices and now you are using the the location of the keypoints only - why did you do this?

Thanks in advance, Tal