How are you estimating bone rotation from Mediapipe poses?

lanthaon / sl-animation-blender

A project where motion capture data is created based on the AI solution MediaPipe Holistic and applied to a 3D character in Blender

MIT License

67 stars 18 forks source link

How are you estimating bone rotation from Mediapipe poses? #2

Closed AmitMY closed 3 years ago

AmitMY commented 3 years ago

Really cool work!

I can't seem to find in the repo a model or algorithm that performs the pose-to-rotations transformation. Is that something delegated to Blender to perform?

lanthaon commented 3 years ago

Hi Amit, thank you :)

This is right, the rotations are calculated by Blender. It happens automatically in every keyframe through the stretch-to-constraint:

https://docs.blender.org/manual/en/latest/animation/constraints/tracking/stretch_to.html