eridgd / WCT-TF

TensorFlow/Keras implementation of "Universal Style Transfer via Feature Transforms" from https://arxiv.org/abs/1705.08086
MIT License
319 stars 79 forks source link

Faces look contorted #10

Open redwraith2 opened 6 years ago

redwraith2 commented 6 years ago

When I run stylize with human faces as the content image, it can often make them look severely contorted. Usually, it will make teeth look larger, edges of the face are slightly wavy and eyes look puffy and very asymmetric in size and shape. Similarly, if you run stylize on a landscape with zero alpha, it produces a simplified version of the photo resembling a watercolor. Is there any way to prevent/change/tune this behavior so inputs look less contorted/higher detail?

Image size doesn't seem to matter for this effect. I'm running this on 1080+ resolution images.

redwraith2 commented 6 years ago

Seems to be this is actually a sizing thing caused by relu5_1 compression -- when I gave it a zoomed in selfie, it went away when I increased the resolution from 512 to 1024. For human portraits, it needs to be 2048 for eyes to look natural.

It also goes away completely when you only use relu1-4.