search

deepfakes / faceswap-playground

User dedicated repo for the faceswap project
306 stars 194 forks source link

How to enable adversarial loss when using GAN? #218

Closed g0147 closed 5 years ago

g0147 commented 6 years ago

May i know how to enable adversarial loss function when using GAN for handling occlusion?

torzdf commented 6 years ago

-pl

I wouldn't recommend using GAN. It doesn't work very well. Will probably be removed soon with a view to re-porting.

bryanlyon commented 6 years ago

Asking for adversarial loss in GAN for obstructions is like asking for how to enable the internal combustion on an f150 to tow a cruise ship. You're asking for the wrong feature and even the feature that does exist doesn't work like you seem to want.

The "A" in GAN is adversarial and it's the default mode. It does nothing to handle occlusion though. It's just a way to train a model with an adaptive loss.

The feature you're actually looking for is a segmentation mask. This does exist in the GAN, but it's incomplete and insufficient for most occlusions. It does not remove occlusions automatically and requires a lot of manual intervention to accomplish removing them. If you're still interested in this type of capability, please come ask more in our Discord chat at https://discord.gg/u8wEDa . We can answer more questions and guide you on how to mask your images and handle occlusions.

g0147 commented 6 years ago

I wouldn't recommend using GAN. It doesn't work very well. Will probably be removed soon with a view to re-porting.

Will update to faceswap-GAN v2.2 ?