makehumancommunity / mpfb2

MPFB2 is a free and open source human generator for Blender
http://static.makehumancommunity.org/mpfb.html
Other
295 stars 33 forks source link

Shape keys for facial animation #169

Open IvailoBurov opened 7 months ago

IvailoBurov commented 7 months ago

There are currently no shape keys available for mouth animation as in Makehuman. They are also missing for the eyes. The only way to do this is to use bones from the standard rig, but in this case the mixamo animations cannot be applied. This means that the exported model is not subject to facial animation, especially when using the Mixamo rig.

joepal1976 commented 7 months ago

There are two parts to this.

For getting a mixamo-compatible rig with facial bones, there is #127. This is on the todo list.

For shapekey-based animation with, for example, visemes, I would need help. The part that is missing is a set of targets for the shapes that are desired. I'm not good enough of an artist to design these. The shapekey data from MHX cannot be used for license reasons, so it would need to be redone (The MHX data files are GPL2 whereas MPFB promises all assets are CC0).

IvailoBurov commented 7 months ago

Ready Player Me models come with built-in visemes. They look correct and key shapes are used. https://readyplayer.me There are ready-made models for download in fbx format.

Vidyut commented 3 months ago

If we can make the targets, there's a branch of Rhubarb lip-sync that's working with Blender 4 using actions. MPFB will blow other human animation plugins out of the water. Particularly if there's also a mixamo rig with a rigify face. Game over even for paid generators, I think. I don't use paid generators, so can't say for sure.