KwaiVGI / LivePortrait

Bring portraits to life!
https://liveportrait.github.io
Other
11.53k stars 1.19k forks source link

changing eye gaze direction #216

Open secutron opened 1 month ago

secutron commented 1 month ago

currently WIP,

image

image

image

image

secutron commented 1 month ago

image

image

FurkanGozukara commented 1 month ago

wow nice

harisreedhar commented 1 month ago

@secutron Can eye look up and down as well?

kunibald413 commented 1 month ago

@secutron can you share your code as a snippet?

secutron commented 1 month ago

@secutron Can eye look up and down as well?

image

image

secutron commented 1 month ago

@secutron can you share your code as a snippet?

Sorry, but I need to work a few more weeks. I will share the code right after finishing my job.

Mayorc1978 commented 1 month ago

Shouldn't it be named Retargeting reference, instead of Retargeting Result, and using different image instead of the same subject?

kunibald413 commented 1 month ago

@secutron could you explain briefly how how did it?

secutron commented 1 month ago

Check the followings: https://github.com/KwaiVGI/LivePortrait/blob/main/assets/docs/changelog/2024-08-06.md

Mayorc1978 commented 1 month ago

Check the followings: https://github.com/KwaiVGI/LivePortrait/blob/main/assets/docs/changelog/2024-08-06.md

Very cool and this is the second half part I asked in my post, are you also going to make the image to image part for precise referencing? Cause this new implementation is definitely good for fine-tuning.

secutron commented 1 month ago

Check the followings: https://github.com/KwaiVGI/LivePortrait/blob/main/assets/docs/changelog/2024-08-06.md

Very cool and this is the second half part I asked in my post, are you also going to make the image to image part for precise referencing? Cause this new implementation is definitely good for fine-tuning.

Do you mean automatically copying facial expressions including eye-gaze?

secutron commented 1 month ago

Check the followings: https://github.com/KwaiVGI/LivePortrait/blob/main/assets/docs/changelog/2024-08-06.md

Very cool and this is the second half part I asked in my post, are you also going to make the image to image part for precise referencing? Cause this new implementation is definitely good for fine-tuning.

Do you mean automatically copying facial expressions including eye-gaze?

I'm not sure this is what the authors intended.

image

Mayorc1978 commented 1 month ago

Check the followings: https://github.com/KwaiVGI/LivePortrait/blob/main/assets/docs/changelog/2024-08-06.md

Very cool and this is the second half part I asked in my post, are you also going to make the image to image part for precise referencing? Cause this new implementation is definitely good for fine-tuning.

Do you mean automatically copying facial expressions including eye-gaze?

I'm not sure this is what the authors intended.

It's exactly what I meant, I pulled the last version from the main repo and the update doesn't have this part you're showing in the picture—just the manual fine-tuning controls (eye/gaze/mouth/head rotation) for image editing. The problem with the manual control is they are not good as a base, cause a lot of guesswork is involved to match a reference picture, and they are not realtime, that's why I said there should be a face(expression/pose) copying function for images, and then you can later fine-tune everything with manual controls that use relative values (relative, cause absolute values would mess up the copied face with the value set in the controls). Where do I get the version that also includes the Face Copying module?