search

OpenTalker / StyleHEAT

[ECCV 2022] StyleHEAT: A framework for high-resolution editable talking face generation
MIT License
627 stars 77 forks source link

Cross-Identity Reenactment #8

Closed cmmclee closed 1 year ago

cmmclee commented 2 years ago

The identity of the generated video is different from that of the input image. Is this an inherent problem？How to fix it? Thanks

cmmclee commented 2 years ago

the same with #12

FeiiYin commented 1 year ago

Thanks for your attention. I recommend using the optimization-based inversion methods, e.g. PTI or BaberShop to inverse the target identity. The identity will be strongly improved compared with the encoder-based inversion methods. The cross-id scenario will distort the original face, which is due to the incomplete decoupled identity information introduced by 3dmm. Incorporating information-bottleneck blocks to filter the information may help.