search

zyainfal / One-Shot-Face-Swapping-on-Megapixels

One Shot Face Swapping on Megapixels.
Other
314 stars 40 forks source link

some unknown reason badcases #25

Open Arthurzhangsheng opened 2 years ago

Arthurzhangsheng commented 2 years ago

when I pick the celabAHQ img id randomly to swap, some id pairs seams wrong

badcases: 9b938af55d9a486842fb84e86d58bd0 1576ceb4f1576f5ca5f45444c6d07d8 2-116 3-116 2-120 3-120 25043-1291 25043-1302 25043-1851

normal cases: image

anyone know why?

zyainfal commented 2 years ago

For bad examples, HieRFE may predict bad latent codes for FTM to swap faces. These bad latent codes may not be used even for reconstruction. So, you could solve this by refining those latent codes through optimized GAN Inversion methods.

Or, you may want to fine-tune HieRFE and FTM with more data, which should be helpful either.

LiUzHiAn commented 2 years ago

Exactly, some other similar cases were found when swapping faces from CelebAMask-HQ.

29230_to_29714, 29198_to_28541, 29387_to_28689 (in to format)

Normal cases: