search

hecomi / uLipSync

MFCC-based LipSync plug-in for Unity using Job System and Burst Compiler
https://tips.hecomi.com/entry/2022/01/30/152519
MIT License
1.01k stars 125 forks source link

How to set Blendshape automatically #50

Open hansolGib opened 1 year ago

hansolGib commented 1 year ago

hello, I'm trying to load or instantiate vrm character at runtime and lip-sync it according to the audio at runtime. if I use a character already in the scene, it's working without any issue as I already assigned the blend shape to the corresponding Phoneme. but it seems lip-sync is not working when I instantiate or load a new character. I found it is because the new character's facial blend shape is not assigned to Phoneme and blend shape in U lip sync blend shape. How can I assign the blend shape to Phoneme automatically? Since I use vroid characters, they all have same blend shape such as Fcl_MTH_A,Fcl_MTH_I,Fcl_MTH_U.

hecomi commented 1 year ago

Hello,

uLipSync supports runtime setup, and you can learn how to assign the blend shape to Phoneme automatically in Sample 10-2 (This is for VRM 1.0 Expression). For more details, please refer to my blog post: