numz / sd-wav2lip-uhq

Wav2Lip UHQ extension for Automatic1111
Apache License 2.0
1.19k stars 161 forks source link

Close the Original Mouth Video Feature? #34

Closed holycowdude closed 10 months ago

holycowdude commented 11 months ago

I'm trying to reuse a video of someone talking to make them say something else but when I process the video using Wav2Lip I can still see the original mouth talking between silence / gaps in the new audio

Is it possible to close the original mouth on a video before adding the new lip movements? Or is there something we could add to the text prompt to close the mouth as a 1st pass?

Thanks and keep up the good work! 👍

numz commented 11 months ago

Hi,

Yes you can try add increase "Mouth Mask Dilate" and " mask blur" for example "30/60" let me know

holycowdude commented 10 months ago

Thanks, i've tried again with 30/60 settings but the mouth can still be seen open and moving when it should be closed between words... i'll keep trying different settings

numz commented 10 months ago

I'll update slider to 128px in futur update