nkeeline / OpenPose-to-Blender-Facial-Capture-Transfer

This blender Python Script maps an OpenPose Facial Capture to a blender facial Rig
MIT License
297 stars 60 forks source link

Keypoint positioning using bones #7

Open alter-sachin opened 4 years ago

alter-sachin commented 4 years ago

Hi, Thankyou for making this. I am not that good in blender, so I am having trouble adjusting the bones to the right position and animating

First, Does the face model need particular features for this to be possible or a general face obj can be animated by attaching keypoints ?

Second, can you suggest a clear picture that showcases which bone goes where ? I see there are less keypoints as compared to the openpose face keypoint list.

alter-sachin commented 4 years ago

Would request your assistance .

rebeccasayej commented 3 years ago

hi thx for this work, for me it works perfectly for the face, but i also need something for the hands which i can not find how to connect them since there is no code to link them. i saw openpose works perfectly with hands but i do not know how to integrate that with blender.

i would be thankful if u help me in this, thanks

Aurosutru commented 3 years ago

For those who are familiar with python programming in Blender it could be easy to take the 2D output from OpenPose to create hand and body joint movements in pose mode, with the same camera lens, distance and orientation with the subject as the original capture video. An OpenPose compatible rig is available for Blender from MakeHuman. This is an interesting approach to convert a video into a Blender armature action that would make a great addition to your facial mocap.