search

KwaiVGI / LivePortrait

Bring portraits to life!
https://liveportrait.github.io
Other
11.67k stars 1.21k forks source link

Looks the `pose` in **animation region** doesn't work #338

Open westNeighbor opened 3 weeks ago

westNeighbor commented 3 weeks ago

I tested several, but looks the pose in animation region doesn't work (tried the pose-friendly option too).

westNeighbor commented 3 weeks ago

examples:

Screenshot 2024-08-19 at 1 03 07 PM Screenshot 2024-08-19 at 1 08 48 PM
cleardusk commented 3 weeks ago

You can try to Uncheck the relative motion @westNeighbor

westNeighbor commented 3 weeks ago

You can try to Uncheck the relative motion @westNeighbor

Okay, that's the trick! Thanks!

westNeighbor commented 3 weeks ago

@cleardusk , now new issues coming up, the exp or all doesn't work anymore when uncheck relative motion. Also, you can't combine the options, like eyes and lip, can it be possible to make these animation region work in combination and under the same conditions (don't need to change the relative motion)?

Mystery099 commented 3 weeks ago

Thanks for your feedback. @westNeighbor

  1. When the driving input is an image and you select relative motion, it means that the driving motion is the motion deformation of the driving image and its canonical space image. The two are identical in the pose, only different in expression, so the pose deformation is 0, that is, there is no driving motion related to the pose. Therefore, when the driving input is an image and you select relative motion, the pose option will not produce any animation. If you uncheck relative motion and select pose when the driving input is an image, it will be absolute driving and the head pose of the animated image will be the same as the driving image.

  2. When the relative motion option is unchecked and exp and all are selected respectively, the results are as follows. If you find that the options do not work after unchecking relative motion and selecting exp or all, please provide more information such as screenshots.

animation_expression_absolute_example1

animation_all_absolute_example1

  1. If you want to select both eyes and lip, you can choose exp, which encompasses eyes, lips, and additional facial motions, excluding head pose. You can also choose whether to enable relative motion. The driving modeling method (relative motion or not) and regional control (exp, eyes, etc.) are compatible and function effectively together.