search

lanthaon / sl-animation-blender

A project where motion capture data is created based on the AI solution MediaPipe Holistic and applied to a 3D character in Blender
MIT License
67 stars 18 forks source link

facial animation #6

Open iatenothingbutriceforthreedays opened 2 years ago

iatenothingbutriceforthreedays commented 2 years ago

hi, thanks a lot for these scripts. I have been spending some hours trying to get facial animation to transfer but without much success. I'm using a 'copy location' constraint instead of 'copy rotation' for the facial bones, but the facial animation is still really messed up. Not sure how this should be done, please let me know if you have any tips.

lanthaon commented 2 years ago

Hi,

I worked on another script where the face is animated and will upload it soon.

Tips that I have:

  1. don't use the depth values of the face points, they will just deform the face
  2. the points need to be scaled to the proportions of the avatar face. I divided the face into different regions (left eye, right eye, nose, mouth) and scaled them individually.
  3. points need to be translated to the best fitting place of the avatar face. This needs to be done for every frame and AFTER animating the body, since the head movement changes