magic-research / GETAvatar

[ICCV 2023] GETAvatar: Generative Textured Meshes for Animatable Human Avatars
https://getavatar.github.io/
MIT License
104 stars 8 forks source link

The normal is flipped #5

Open ne1114 opened 1 year ago

ne1114 commented 1 year ago

Hello while experimenting I am facing weird behavior and would like to ask for tips.

When training, the normal vector of the generated mesh gets flipped.

So like in 20th epoch, the normal vector is facing outwards, however around 40th epoch the normal vector starts becoming "noisy". And in 40th epoch the normal vector get completely flipped so facing inwards.

Have you guys encountered this kind of phenomenon ? Could I get a tip on what may be causing this issue please?

ne1114 commented 1 year ago

20th Screenshot 2023-11-06 at 5 23 14 PM

40th Screenshot 2023-11-06 at 5 23 23 PM

60th Screenshot 2023-11-06 at 5 23 29 PM

The image is taken from the same camera position. Note the normal is changing. This alternating normal keeps happening throughout the training process.

Xuanmeng-Zhang commented 1 year ago

Hi @ne1114 Could you please provide more details? Which dataset are you using? Could you please show me the real images?