advimman / lama

🦙 LaMa Image Inpainting, Resolution-robust Large Mask Inpainting with Fourier Convolutions, WACV 2022
https://advimman.github.io/lama-project/
Apache License 2.0
8.12k stars 861 forks source link

question about the removal of the chromatic aberration in inpainting #280

Open D222097 opened 11 months ago

D222097 commented 11 months ago

In the example of lama, I found that the texture of masked area is reasonable but with chromatic aberration. What could be the reason for this? 5089a2acbb6b480d73fa0557ac323b1e b13d8205e8c9ddf60959ee208f0d88f4

jiaxue-ai commented 7 months ago

It occurs because the pixel loss exclusively applies to the unmasked area, while the masked region employs perceptual loss and adversarial loss, emphasizing perceptual similarity.

To ensure consistency in low-frequency color, consider retraining the model with a loss function tailored for color consistency in the masked region.