KwaiVGI / LivePortrait

Bring portraits to life!
https://liveportrait.github.io
Other
11.71k stars 1.22k forks source link

Hiccup when using two - almost identical - driving videos stitched together #282

Open 3unjee opened 1 month ago

3unjee commented 1 month ago

Hello,

I'm using a composite driving videos with two - almost identical - webcam recording stitched together. Unfortunately, I notice a clear hiccup at the point of transition (right after the 5 seconds mark):

https://github.com/user-attachments/assets/830c52da-f783-45c7-970f-aee765a1fdc7

I found a way to mitigate the effect by adding a fade in / fade out between the two, although the character clearly advances his chin (right after the 5 seconds mark):

https://github.com/user-attachments/assets/0f3ea1ce-3206-4a82-95d1-4af84937bc08

Ideally, one should use a single source for the entire driving video. However that's impractical if you want to iterate on section of the dialog without recording everything again. For LivePortrait, could you come up with better interpolation that handles sudden variation in the driving video more smoothly ?

3unjee commented 2 weeks ago

The situation greatly improved in the 2024/08/29 version,