search

williamyang1991 / VToonify

[SIGGRAPH Asia 2022] VToonify: Controllable High-Resolution Portrait Video Style Transfer
Other
3.53k stars 442 forks source link

About ghosting artifacts #61

Closed kasim0226 closed 1 year ago

kasim0226 commented 1 year ago

Thank you for your great work. It is impressive.

In the paper, you mentioned "The artifacts mainly come from the scale mismatches between the stylized facial region and remaining regions."

I am wondering the ghosting artifacts are from paired data you created or just appear in VToonify inference?

williamyang1991 commented 1 year ago

Our paired data don't have ghosting artifacts. The ghosting artifacts are becuause VToonify is trained to fuse the features before and after stylization, which will have artifacts near the mismatched regions.