Rokoko Studio is a powerful and intuitive software for recording, visualizing and exporting motion capture.
This plugin lets you stream your animation data from Rokoko Studio directly into Blender. It also allows you to easily record and retarget animations.
The character in Blender has to be in T-pose:
For SmartGloves: Make sure that the character's hands and fingers are posed as close as possible to the following pose to get the best possible retargeting of finger animation. All fingers should be straight and the thumb should be rotated 45 degrees away from the other fingers.
In Rokoko Studio go to settings and click on Studio Live in the dropdown menu and enable the Blender data stream. You can customize the streaming address and port by clicking the wrench icon at the top left
In the 3D view press N or the little arrow on the right side, then select the "Rokoko" tab and press "Start Receiver" to start receiving data from Rokoko Studio
After starting the receiver select the armature that you want to animate
Go into the object category and open the "Rokoko Studio Live Setup" panel
In the actor field select the Smartsuit that you want to use for this armature
Fill all bone fields by pressing “Auto Detect” and check if all bones are correctly filled in and fill in missing bones if necessary
Ensure that the selected armature is in T-Pose and then press “Set as T-Pose”
Done! Your armature should be animated by the live data:
Optional: In order to improve animation performance enable “Hide Meshes during Play” in the receiver panel
If you experience any lag while using the plugin, close the window that shows key frames (e.g. timeline or action editor). Blender will run much smoother as the panel takes a lot of resources.
This uses the exact same workflow as streaming character data
Just select the face mesh for face data or the object for prop data and then follow the steps above
Done! Your face mesh or prop should now be animated by the live data
Note for prop data: After selecting the prop data you can turn on "Use Custom Scale" and change the animation scale for this prop, to make sure it fits your Blender project
In order to retarget an animation in Blender you will need to do the following:
Open the Retargeting panel
Select an armature with an animation as the source armature, select an armature that should receive the animation as the target armature and then press "Build Bone List"
Check if the bones got filled in correctly and fix any incorrect or missing bones
Select "Auto Scale" if the armatures differ in size or resize them manually
In "Use Pose:" select the pose that should be used for retargeting
Important: Make sure that both armature are in the same pose for correct retargeting
Press "Retarget Animation"
Done!