search

KwaiVGI / LivePortrait

Bring portraits to life!
https://liveportrait.github.io
Other
11.67k stars 1.21k forks source link

Why does the generated video audio not match the mouth shape when driving videos with videos? The same applies to comparison videos, where the mouth shape and sound do not match when comparing the original video with the three consecutive videos #358

Open nkxhl opened 2 weeks ago

nkxhl commented 2 weeks ago

Why does the generated video audio not match the mouth shape when driving videos with videos? The same applies to comparison videos, where the mouth shape and sound do not match when comparing the original video with the three consecutive videos

simplyexperimental commented 2 weeks ago

The source and driving video must match in frame rate. Right click the properties of both videos and in the properties section see the frame rates. I use a video editor known as Avidemux 2.7.8 (best for me) with a MPEG-4 AVC codec (default settings) and choose the filter called something like "resample fps but keep duration" filter setting to match the driving video usually 30 fps. Most videos off the internet will be slightly less than 30 fps some even 14fps.