KwaiVGI / LivePortrait

Bring portraits to life!
https://liveportrait.github.io
Other
10.98k stars 1.11k forks source link

It breaks when driving video doesn't have space above head. #81

Open simplyexperimental opened 1 month ago

simplyexperimental commented 1 month ago

It have a very hard time when driving video is a bit close and no space above forehead. I thought it tracked main face features but it might be tracking full head in frame and loses accuracy and gets confused when head mainly upper head is not in frame of the driving of video.

Examples (Pretend these are driving videos) It can do this kind of video showing face with lots of space above head (success). But it get very weird with driving video which are closer and stop at the forehead - and these are very common kinds of clips (fail) . ---179

cleardusk commented 1 month ago

Sorry for the late reply. We have updated a guide here: https://github.com/KwaiVGI/LivePortrait?tab=readme-ov-file#driving-video-auto-cropping : )

simplyexperimental commented 1 month ago

Sorry for the late reply. We have updated a guide here: https://github.com/KwaiVGI/LivePortrait?tab=readme-ov-file#driving-video-auto-cropping : )

Hi, Can you be more specific - I was saying that there are bad results when the driving video is too zoomed in like those first 4 samples I put above. Can you explain what has changed to fix this?