search

yerfor / GeneFacePlusPlus

GeneFace++: Generalized and Stable Real-Time 3D Talking Face Generation; Official Code
MIT License
1.5k stars 219 forks source link

Natural blinking when inference #119

Open Gina07 opened 7 months ago

Gina07 commented 7 months ago

Hello, I found that adding the 'period' blink_mode at inference will result in flicker of the whole head. Another approach to add 'blinking' is like that from GeneFace, to replace the lm3d of eye region with GT eye_pattern in training dataset. But I found that still results in head flicker when blinking, and it has a bad influence on the lip animation as well. Even after I used LLE to project them to the manifold of training data. I am confused why it happened since all the eye_patterns are from training set. Do you have any suggestion on how to add natural blinking at inference Thanks a lot.

jryebread commented 6 months ago

interested in this answer as well!

super-animo commented 5 months ago

+1