Can FLAME model close eyes?

TimoBolkart / TF_FLAME

Tensorflow framework for the FLAME 3D head model. The code demonstrates how to sample 3D heads from the model, fit the model to 2D or 3D keypoints, and how to generate textured head meshes from Images.

http://flame.is.tue.mpg.de/

444 stars 78 forks source link

Can FLAME model close eyes? #29

Closed foamliu closed 4 years ago

foamliu commented 4 years ago

We'd like to use FLAME model to fit RGB-D photos, but seems unlike BFM, FLAME model never close her/his eyes. Is this observation valid?

TimoBolkart commented 4 years ago

FLAME is able to close the eyes / do an eye blink. You can see for instance the demo in the VOCA repository that animates the eyelids using FLAME. If your fitting does not close the eyes, this is either due to the supervision (i.e. imprecise eye landmarks) or a too high regularization for the expression parameters. Adding an additional loss to minimize the distance between the eyelid keypoints might help in this case.