numz / sd-wav2lip-uhq

Wav2Lip UHQ extension for Automatic1111
Apache License 2.0
1.23k stars 163 forks source link

Transfer Lips from original Video to generated Vid #2

Closed p0mad closed 1 year ago

p0mad commented 1 year ago

Hi, My video is not English! and I've created a video using SD+CN using Img2img. (creating a video from existing Video) So i was wondering if it is possible to use your great project to map the original Video Lips and face motions to the generated Video ( which lacks the accuracy on Lips and face motions)?

Thanks Regards

p0mad commented 1 year ago

I dont need to use Audio! Just map the lips and face motions between the two videos!

numz commented 1 year ago

Hi,

I'm sorry, but in its current state, the project does not support transferring the lip and face movements from an original video to a generated video. However, it's worth noting that Wav2Lip is designed to work with many languages, so if you have an audio source of the speech, it should work well.

Nevertheless, this is an interesting idea and could be a feature to consider for future updates. Please send me one image from the original video and one from the generated video. I'll then see if I can easily update the project.

Thank you for your interest in our project!

p0mad commented 1 year ago

@numz May i have your Skype, Telegram, Email Address? Best regards

numz commented 1 year ago

my discord : NumZ#7184

p0mad commented 1 year ago

@numz Sent a request

numz commented 1 year ago

Ok, i have accepted, I close the issue :)