search

KwaiVGI / LivePortrait

Bring portraits to life!
https://liveportrait.github.io
Other
12.09k stars 1.27k forks source link

Using the "keeping the lip silent" broke the videos (Retargeting) #344

Open ZeroCool22 opened 1 month ago

ZeroCool22 commented 1 month ago

👉Original video:

https://github.com/user-attachments/assets/9ea2b27c-85f7-40c8-b224-fb0f6d2336df

👉Retargeting with keeping the lip silent:

https://github.com/user-attachments/assets/bfa4c48d-1258-4f74-9de6-cefcf653b999

https://github.com/user-attachments/assets/d47bcf32-cc85-4af8-95eb-0a1521beb0f0

👉Retargeting with only target lip-open ratio set to 0, (with keeping the lip silent uncheck) is not enough because the lips keep moving:

https://github.com/user-attachments/assets/ccad079c-888f-4ef4-a306-4826afee240c

https://github.com/user-attachments/assets/54592d8e-690c-4427-90d3-4a25292450e6

videocringe commented 1 month ago

similar problem, when using “keeping the lip silent”, the mouth closes, but the whole head becomes bigger or vice versa smaller. Is there any solution?

simplyexperimental commented 1 month ago

In my case the re-target for a completely still face has the face having jitter shakes. Also it might be a bug or something but all the re-targets take 20 minutes+ while the normal uses from driving to image or video only take a few mins max.