apchenstu / sofgan

[TOG 2022] SofGAN: A Portrait Image Generator with Dynamic Styling
Other
763 stars 102 forks source link

Irises repeat themselves to fill out eyes #36

Open torridgristle opened 2 years ago

torridgristle commented 2 years ago

When drawing admittedly unrealistic eye sizes sofgan will repeat an iris and corners inside of the eye instead of making a larger iris to fill the eye shape. This is a problem when trying to draw stylized faces or caricatures.

Perhaps warping the photos and segmaps with PyTorch's grid sampler to bend, twist, shrink, expand, fisheye, etc will encourage the model to fill eyes with a single iris that fits the eye shape and size.