search

KwaiVGI / LivePortrait

Bring portraits to life!
https://liveportrait.github.io
Other
11.45k stars 1.17k forks source link

FEATURE REQUEST - Possibility to pose a single image using another image (not a video) as ref and then retargeting using controls for refinement for eyes/mouth/pitch... #225

Open Mayorc1978 opened 1 month ago

Mayorc1978 commented 1 month ago

Live portrait does image to video and video to video, but what about image to image? Would be interesting to pose single images based on reference and to create a pose template (instead of a motion template) to make batch image to image posing and later be able to finutune the look with Retargeting controls like in the sample app.py.

cleardusk commented 1 month ago

Do you mean pose-transfer? @Mayorc1978

alexbofa commented 1 month ago

Do you mean pose-transfer? @Mayorc1978

I have the original image, and there is a reference to the facial expressions that I downloaded from the Internet. I get the result from the downloaded image. img2img Example: when I have a photo of a person who is sad, I want to add a smile to him, but so that it remains an image, not a video.

Mayorc1978 commented 1 month ago

Do you mean pose-transfer? @Mayorc1978

Yes, face pose and expression that LivePortrait does very well, even when the driving video has a wide range of motion. Summarizing, a possibility to drive the portrait by image not just by video, and make reusable face "pose/expression" templates not just motion templates, made on the fly, based on a driving video.

jaco001 commented 1 month ago

Changing one image to one frame video is rather easy and you don't need changing a code. I miss something?

Mayorc1978 commented 1 month ago

Changing one image to one frame video is rather easy and you don't need changing a code. I miss something?

Still not the proper way to do it, that's an hack.

secutron commented 1 month ago

Plz refer to the following: https://github.com/KwaiVGI/LivePortrait/issues/216