Animating via Webcam and Openpose

ndee85 / coa_tools

COA Tools is a 2D Animation Suite for blender. It offers a 2D cutout animation workflow similar to programs like spine or spriter.

GNU General Public License v3.0

900 stars 139 forks source link

Animating via Webcam and Openpose #178

Open magdesign opened 3 years ago

magdesign commented 3 years ago

Would it be somehow possible to drive COA characters with a webcam ? For example using the OpenPose library?

https://github.com/CMU-Perceptual-Computing-Lab/openpose https://gitlab.com/sat-metalab/blender-addon-openpose https://github.com/nkeeline/OpenPose-to-Blender-Facial-Capture-Transfer

davord45 commented 3 years ago

COA tools meshes are just a simple Plane meshes. So if you figure out how to make that library work on a regular 3d rig i dont see why it wouldnt work on a COA one.Just make sure to limit the transform to only 2d axis X and Y.

ndee85 commented 3 years ago

as davord45 said, basically the output of coa tools is regular 3d geometry fixed to 2 axis. This surely could be coupled somehow. However, this is currently out my personal scope.