Doubiiu / CodeTalker

[CVPR 2023] CodeTalker: Speech-Driven 3D Facial Animation with Discrete Motion Prior
MIT License
515 stars 57 forks source link

How to add natural blinking motions? #44

Closed leetesla closed 1 year ago

Doubiiu commented 1 year ago

As CodeTalker is trained on the dataset without blinking motions, it is impossible to produce these motions. One way to solve this is to retrain it on datasets with these blinking motions, another one I think is to convert the results into FALME parameters and add motions using the parametric method, then convert back to mesh.