search

met4citizen / TalkingHead

Talking Head (3D): A JavaScript class for real-time lip-sync using Ready Player Me full-body 3D avatars.
MIT License
346 stars 106 forks source link

Bad mouth effect during speaking #35

Closed branaway closed 6 months ago

branaway commented 6 months ago

Currently the mouth templates in the mood configurations interferes with the visemes and render bad looking lip shapes. Should it ignore the mouth template in the moods while the avatar is speaking?

met4citizen commented 6 months ago

You are right. Each mood has its own baseline expression, and the mouth doesn't always look natural while speaking. If I completely ignore the mouth's baseline while speaking, however, it will make the avatar look a bit too happy even when angry/sad. Perhaps a good compromise is to restrict the mouth's baseline values to one-third (or something) while speaking. I will look into this. Thank you.

branaway commented 6 months ago

I saw the changes. Thanks! That helps a lot.