search

KwaiVGI / LivePortrait

Bring portraits to life!
https://liveportrait.github.io
Other
11.45k stars 1.17k forks source link

BUG? (not sure) - Retargeting changes not applied to the final result video #113

Open AlonDan opened 1 month ago

AlonDan commented 1 month ago

I'm not sure if it's a bug or I'm missing something:

I've tried to compare default "Animate" button with no changes. Then I've played with the "Retargeting" sliders, did some EXTREME changes and it shows it on both of the retargeting result previews, so far so good 👍

But when I press "Animate" again to see the changes, but both gave the same result exactly (no retargeting, only the default result)

All 3 options are ENABLED by default: ☑relative motion | ☑do crop (source) | ☑paste-back (this one supposed to do the job right?)

Do I need to enable some option in order to get the Retarget result?

FurkanGozukara commented 1 month ago

Retargeting not implemented to animation currently

Inferencer commented 1 month ago

I did the same thing I didn't read it properly when I first looked at it I assumed the same as you and they just put the location in a weird place in the UI but it wasn't the case.

It's good if the first frame of the driving vid matches the source image in terms of eye openness and mouth openness so for instance if you need the source image mouth to be closed you would use the re-targeting feature, then download the resulting image and re-upload as your source image.

AlonDan commented 1 month ago

I guess I assumed it's already working based on the examples from the paper, The same for the not yet applied Video as Source. I hope these features will be added soon it will be nice to experiment with Video Source + Retargeting.