search

NVlabs / eg3d

Other
3.24k stars 363 forks source link

Bad quality in extreme pose face generation #75

Closed anjith2006 closed 2 years ago

anjith2006 commented 2 years ago

I am observing that there are artefacts when face is in extreme poses (+-90 degree yaw), Is there a way to avoid this. Or is it the background ? An example is shown here. Screenshot 2022-10-20 at 3 23 00 PM

Thanks!

matthew-a-chan commented 2 years ago

Hi,

Thanks for the comment. This is somewhat expected for the FFHQ (and AFHQ) models. Both of these faces datasets contain almost entirely frontal views (in fact, the majority of FFHQ faces fall within ~30 degree deviation from frontal). For that reason, the +-90 degree views you show here are essentially unseen in training.

For your case specifically, It's hard to diagnose the exact problem from just these images but there's a chance that increasing the near plane could help reduce floaters (but may also possibly cut into the person's face, if increased too much).