tencent-ailab / V-Express

V-Express aims to generate a talking head video under the control of a reference image, an audio, and a sequence of V-Kps images.
2.18k stars 272 forks source link

An alternative project EchoMimic is open-sourced #49

Open lymhust opened 2 months ago

lymhust commented 2 months ago

EchoMimic is capable of generating portrait videos not only by audios and facial landmarks individually, but also by a combination of both audios and selected facial landmarks. Project link: https://badtobest.github.io/echomimic.html GitHub link: https://github.com/BadToBest/EchoMimic image

https://github.com/tencent-ailab/V-Express/assets/18476076/c5791b30-ea2c-4961-9145-afc4cff55bda

https://github.com/tencent-ailab/V-Express/assets/18476076/e0b82155-71ad-429f-bbfc-44bde34f3f4b

FurkanGozukara commented 2 months ago

LivePortrait looks better than this have you compared?

https://youtu.be/FPtpNrmuwXk

Arvrairobo commented 1 month ago

@FurkanGozukara but how to generate audio driven image portraits with liveportraits? right now its only video driven? any thought on that?

FurkanGozukara commented 1 month ago

@Arvrairobo currently liveportait doesn't support audio driven sadly :/