DanielSWolf / rhubarb-lip-sync

Rhubarb Lip Sync is a command-line tool that automatically creates 2D mouth animation from voice recordings. You can use it for characters in computer games, in animated cartoons, or in any other project that requires animating mouths based on existing recordings.
Other
1.71k stars 208 forks source link

Feature request: Extending beyond the 3 extended mouth shapes #146

Open TopraksoyEarthmanTsuchimoto opened 1 month ago

TopraksoyEarthmanTsuchimoto commented 1 month ago

We are very happy to be making use of Rhubarb-Lip-Sync during the development of SPEAKWORLDLANGUAGES app.

The talking character in our app is animated with the 9 shapes of Rhubarb which are ⒶⒷⒸⒹⒺⒻⒼⒽⓍ. And then there is one more mouth shape we are adding to the json files by hand which is used when the character has to say something using the consonants such as "N", "D" and "TH" like when you say Night, Day and That. The 10th mouth shape we've added looks like the Ⓗ shape but with the lips slightly closer to each other and it greatly improves the quality of the animation.

This being the case, we have been wondering if it would be possible to detect the "N", "D" and "TH" consonants and assign them a new mouth shape which would be the fourth extended mouth shape.

With regards to the members of Rhubarb-Lip-Sync community.