search

DanielSWolf / rhubarb-lip-sync

Rhubarb Lip Sync is a command-line tool that automatically creates 2D mouth animation from voice recordings. You can use it for characters in computer games, in animated cartoons, or in any other project that requires animating mouths based on existing recordings.
Other
1.85k stars 223 forks source link

Allow lower frame rates #112

Open manongjohn opened 2 years ago

manongjohn commented 2 years ago

I know typically the standard digital animation frame rate is 24 FPS, though some may chose lesser, like 12 FPS, used more by hand drawn animation.

Currently the app doesn't allow anything less than 24 FPS. I've lowered it to 10 in my fork knowing that may cause frames to drop.

Any chance to be able to lower it to at least 12 FPS?

DanielSWolf commented 2 years ago

Currently, Rhubarb always uses 100fps internally (for technical reasons). To achieve any other frame rate, output frames are simply discarded. This is far from ideal, because it can lead to whole parts of the animation being dropped when the frame rate is reduced too much. This is why I set the minimum to 24fps.

I'm currently in the proof-of-concept phase for Rhubarb 2, which won't have this limitation. It'll be a long time though until that's anywhere close to finished. Given that true arbitrary-frame-rate animation would require quite some changes, I don't plan to implement this for Rhubarb 1.

manongjohn commented 2 years ago

Interesting. Since I mostly use 24FPS, that does explain some of what I am seeing, mouth shapes are sometimes off or even missing against the audio.

I'll continue using my fork, for now, and will keep an eye out for when Rhubarb 2 becomes available.

Thanks for the information.

mwilkins1999 commented 7 months ago

Has this been fixed? I'm using whatever the latest version is, but the sync is off. It looks like at first in an animation it's good, but as it goes, it becomes more and more off. Is there a way to lower the frame rate?