search

patrikhuber / eos

A lightweight 3D Morphable Face Model library in modern C++
Apache License 2.0
1.89k stars 596 forks source link

Blendshapes variability #221

Closed mamineayari closed 5 years ago

mamineayari commented 5 years ago

expression

Hi Patrick,

I was not able to get this expression (picture from your thesis report) using the 6 blendshapes model you provide. Are you using the same blendshapes model in this repository ?

patrikhuber commented 5 years ago

Hi Amine,

Yes indeed this result was generated with eos and the 6 SFM expression blendshapes in the repo! You should be able to get somewhat similar results. Maybe play around with the regularisation a bit?

I'm closing this as it's not an issue with the library, but feel free to report back with any more specific questions.

mamineayari commented 5 years ago

the reason I'm saying that, is I played with the 6 blendshapes components of SFM (using the eos-viewer) and none of those (or combination) gives non symmetric mouth expression as in the picture. Everything is symmetric. Am I getting something wrong ?

patrikhuber commented 5 years ago

That's a very good and valid question indeed! I think there is a slight asymmetry in the blendshapes, maybe together with the identity basis, and it's probably hard to recreate by hand, but the fitting figures out the exact right coefficients to make it happen. Maybe you can use the input image that I used (it's from some of the ibug 2D image datasets) or another one and create a toy example with landmarks laid out like this and then fit to them?

mamineayari commented 5 years ago

Yep, I'll do that. Thanks for your answer