KwaiVGI / LivePortrait

Bring portraits to life!
https://liveportrait.github.io
Other
13.12k stars 1.39k forks source link

Video lip sync are out of sync sometime on video #343

Closed wesleyliwewa closed 3 months ago

wesleyliwewa commented 3 months ago

Hello.

I had updated LivePortrait to last night, and I am not sure is that related, or I have been having this issue just I didn't know.

After updating, when process video to video, some videos have no problem, but some of them will be out of sync. I am not meaning the lip sync effect is not good, it is good, but the voice will delay like 0.5s to 1s in the comparison video and result video.

I am trying to figure out is that related to my sources videos, or other reasons for that, and if I find out more I will tell in here.

Just at the same time, if other people have the same issue and solutions, please let me know.

Thank you.

wesleyliwewa commented 3 months ago

Hi, just want to leave a update here.

Finally, I found out the reason, it's because the frame rates of the source and driven videos are different.

I did not notice that before all the source and driven videos I tried were 25 fps, but yesterday I tried couple source videos, which are 30 fps, but using the same 25 fps driven video, so the out of sync issues occurred.

Once I converted the source videos to 25 fps, no issue now.

So pay attention to the frame rates of both source and driven videos, they have to be the same frame rate.

(As I updated the Live Portrait before I had the issues, I was thinking it might related to the new version, and now for sure is not related to the new version.)

Thank you.