haruiz / RiggingJs

Tensorflow.js and Three.js skeletal animation tool
Apache License 2.0
265 stars 31 forks source link

Feature request: Add check expressions to facemesh. #17

Open delebash opened 3 years ago

delebash commented 3 years ago

I have been working on my own project to stream data to the iClone app as I mentioned in one of my posts. What I have been noticing is that facemesh does not seem to pickup cheek movements and in general not good at picking up adequate facial movement for 3D motion caputure. If I puff my cheeks out I would expect facemesh to pickup that information and change the mesh accordingly but I do not see any sign of this movement being detect. With the 468 keypoints I thought it would be better at detecting these movements.