LIVENODING 751 / Animoji Realtime Face Capture in Blender

[enzyme69]

This is an update of my study of real time Face Capture in Blender.

Basically we are using OpenCV computer vision app called FaceOSC app. This handy FaceOSC app allows user to send OSC message that can trigger or drive all kind of attributes in another machine within the network. Your face became a user interface to control 3D face model.

From FaceOSC, I am sending realtime data into Blender using AddOSC app and processing it further using Animation Nodes to "normalize" and adjust the weighting of my face to Suzanne monkey head. The facial rig and blendshapes are important in order to make a good final result.

The setup I am doing here using Blender and webcam is an older technology compared to the iPhone X "True Depth" 3D Front Camera they are showing not long ago. I cannot wait to try the iPhone X to make all kind of 3D Character AR Face animations in real time. I have been wanting to have something like this for many years and it is finally here.

In the meantime, we can make a 3D character face rig in Blender and test it out using this setup. This is actually similar to what Snapchat is using.

BASIC HARDWARE REQUIREMENTS:

• Good Webcam (I am using the old Logitech HD Pro Webcam C910)
• Any good computer that can run Blender (my computer is over 10 years old).

Download Blender 3D Open Source: https://www.blender.org/download/

Blender Animation Nodes: https://github.com/JacquesLucke/animation_nodes

Blender AddOSC: http://www.jpfep.net/pages/addosc/

FaceOSC: https://github.com/kylemcdonald/ofxFaceTracker/releases

BLEND ZIP: AN_FaceOSC_2017_027_2017_09_27_01_33.zip

[Italianorge]

Hi, this is looking very cool! Can yo make a tutorial Please? Thanks Riccardo

[AndreaMonzini]

hello @enzyme69 , what is the license for your software? thank you.

[sanju365]

Please make tutorial on how to make it