search

patrikhuber / 4dface

Real-time 3D face tracking and reconstruction from 2D video
https://www.4dface.io
Apache License 2.0
786 stars 248 forks source link

Moving the face in rendering window #24

Closed Adra8373 closed 7 years ago

Adra8373 commented 7 years ago

Hi

I hope you are doing well.

I have a question about that why the face is moving when the speaker starts to talk, I mean the rendered face is moving not just the lips. Could you answer me, please?

Regards

patrikhuber commented 7 years ago

Hi, I'm not sure what you mean. The head is rotating, yes. But the translation is set to zero. Please clarify and I'm happy to re-open if there is an issue here.

Adra8373 commented 7 years ago

Hi

Thanks for replying. What I meant is that the rendered mesh is moving not just the lips (all the head is moving according to the lips movements. ), I mean it is not as the speaker do when start talking, in usual the head is static, but the lips is moving.

Regards

patrikhuber commented 7 years ago

Ok, I think I maybe see what you mean now. You could use draw_wireframe(...) on the original image to verify the fitting results.

I think what you want is maybe better blendshapes, that don't just model expressions, but lip movements.

Adra8373 commented 7 years ago

Thanks. I used draw_wireframe(...), but I still have the same problem.

patrikhuber commented 7 years ago

draw_wireframe(...) is only for inspecting, obviously. As mentioned above you may want to use some blendshapes that model lip movements.

Adra8373 commented 7 years ago

My model contains different lip shapes already, so I do not need to add them separately.

patrikhuber commented 7 years ago

Ok, cool! Well, then I guess you need to find out why it happens? ;-)