patrikhuber / eos

A lightweight 3D Morphable Face Model library in modern C++
Apache License 2.0
1.92k stars 598 forks source link

Synchronization of facial expression #183

Closed sunjunlishi closed 6 years ago

sunjunlishi commented 6 years ago

The 3D model is estimated with a person's multiple faces. Then the real-time expression change parameters of the face are estimated based on 3D, and then the expression change parameters are applied to other 3D models.

patrikhuber commented 6 years ago

Is there an issue here? :-O I'm closing it meanwhile.

sunjunlishi commented 5 years ago

Can I synchronize one person's expression to another's 3D model using EOS technology?

patrikhuber commented 5 years ago

If they have the same mesh topology, sure, you can just transfer the blendshape weights. I'd recommend you to read some of the literature and perhaps find some forum or community to ask beginner questions, as the GitHub issues are for developer issues with the library. Thanks!

sunjunlishi commented 5 years ago

EOS technology! I want to synchronize expressions on the basis of your EOS functions. Because I found that EOS has many methods of parameter transformation of 3D model, I don't know the exact role, I want to use them flexibly to achieve expression synchronization. so i ask here

patrikhuber commented 5 years ago

Well as I said, one method would be to transfer the blendshape weights. It really depends on your use case, and you need to find out what works best for that.

sunjunlishi commented 5 years ago

oh,yes yes。”one method would be to transfer the blendshape weights“,it is expression param。thanks very much。i think it will works。

sunjunlishi commented 4 years ago

@patrikhuber blendshap weights is very ok.but The mixed shape weight is not perfect, and the details are not in place, such as eyebrow movement and eye movement, because it has only six variables. What should we do

sunjunlishi commented 4 years ago

@patrikhuber thanks for your work. Highlights "Morphable Model, captured from real human 3D face scans 36 expressions and facial action units Topology optimised for animation & real-time use cases Full-head model Two different mesh resolutions"
how could i get "36 expressions and facial action units", how much i can get it.