search

patrikhuber / eos

A lightweight 3D Morphable Face Model library in modern C++
Apache License 2.0
1.92k stars 598 forks source link

Deformation Of Mesh #62

Closed donbader closed 8 years ago

donbader commented 8 years ago

Hi, thank you for your project that it is so wonderful ! But I am wondering if the mesh generated could be deformed like the youtube video below: https://www.youtube.com/watch?v=MMa2oT1wMIs

like the empty eyes, or the contour fitting to 2D face image.

Thanks a lot !

patrikhuber commented 8 years ago

Hi, Thanks! Making the eyes empty should be easy by just removing the associated vertices and triangles. As for the mesh, you can definitely deform a face mesh obtained with eos in a way like that. What they do is beyond the fitting that's available in eos (we fit a PCA shape model and expression blendshapes).

donbader commented 8 years ago

But how can I know which vertices are associated ? Just try and error ?

Thanks.

patrikhuber commented 8 years ago

Just write out the mean face as obj and open it in MeshLab or Blender to select the vertices. You can either use the provided low-res reference.obj, or write out the mean using draw_sample and write_obj, or use the example app generate-obj.

donbader commented 8 years ago

Is it possible to modify sfm_shape_3448.bin and expression_blendshapes_3448.bin like adding some new expression, or adding new face ?

Thanks a lot ! Sorry for many questions , I am a newbie , and I am trying to finish my school project with eos.

patrikhuber commented 8 years ago

I suggest you to read our VISAPP paper (and possibly more) to get a better understanding of the PCA shape model.

Adding new expressions is easy and could simply be done by adding new blendshapes (either from 3D data or manually created ones using for example Blender).

patrikhuber commented 8 years ago

I'll close this, feel free to re-open if you have further questions.