Perceptual loss images with differing masks

cc-ai / kdb

AI can help Visualizing the Impacts of Climate Change. This is an open forum to share our work

https://mila.quebec/en/ai-society/visualizing-climate-change/

Apache License 2.0

19 stars 3 forks source link

Perceptual loss images with differing masks #110

Open 51N84D opened 4 years ago

51N84D commented 4 years ago

Perceptual loss works out of the box with images that share a common mask (the edge artifacts cancel out) but not with images that have differing masks.

One idea: Sample a square crop from the respective masked regions and calculate a perceptual loss between these two. Not sure if this is a differentiable operation though

vict0rsch commented 4 years ago

I think you have interesting results regarding this issue @51N84D ; can you write up a sentence or 2 to close this issue? (+pictures)

51N84D commented 4 years ago

Actually I haven't tried the patch idea yet. What did produce interesting results was using perceptual loss on the reconstructed region, but I haven't yet found a counterpart for the flooded region. Still an open problem so maybe we can leave this one open a while longer