Introduction
This is a simple script which automatically converts Oculus Lipsync data into a Unity animation file to aid in creating lipsync animations
Generating the lipsync data
Converting the lipsync data
- Select the avatar you wish to animate. Select the gameobject with the animator component for the script to function
- Add the component "Lipsync To Anim"
- Drag the audio into "Audio Clip"
- Drag the animation clip you wish to add lipsync to into "Animation Clip" (create a new animation clip if you don't want to modify one)
- Drag the mesh you wish to animate to the "Mouth Object" section
- Setup the viseme names. A prefix option is provided for convenience, leave it blank if your visemes do not use a prefix
- Change any settings you wish
- Click the convert button
- If all went well, you should see the messages "Beginning Conversion..." and "Conversion complete!" appear
Settings
- Oculus Tweaks
- Offline Mode: This toggles the offline mode for the Oculus Lipsync SDK
- Animation Tweaks
- Time Shift: Shift the timing of the animation. This value is in milliseconds
- Viseme Tweaks:
- Min Value: The value below which all viseme keyframes are set to zero (0-100 range)
- Gain: The multiplier applied to the viseme values from the SDK (0-100 range)
- Decimate Value: Determines how aggresively to remove keyframes. There is no hard limit, but its affects are theoretically present from values 0-369,800. Recommended value are below 20,000
- Optimize: Whether or not to remove keyframes which are deemed unnecessary. How many are removed is dependant on the decimation value. Using with with min value and decimate value can reduce the number of keyframes by up to 90% !IT IS HIGHLY RECOMMENDED TO KEEP THIS ENABLED!
- Convert:
- This is not a setting, but rather a button. Clicking this will show no visible feedback, but will run the script with the given settings. You can tell it worked through the message "Conversion Complete" appearing in the console.
Issues
If you have any issues, report the issue on Github
Credits