numz / sd-wav2lip-uhq

Wav2Lip UHQ extension for Automatic1111
Apache License 2.0
1.19k stars 161 forks source link

How about to implement HDTR Net? #50

Closed rebotnix closed 10 months ago

rebotnix commented 10 months ago

I found HDTR Net intereseting, tested it on CMD line, and seems to produce good results. https://github.com/yylgoodlucky/HDTR-Net

Maybe it´s an good alternate for the mouth restauration.

What do you think @numz ?

numz commented 10 months ago

Hi Is that only for teeth restoration?than mean I could Apply this after the wav2lip process? Right?

rebotnix commented 10 months ago

@numz , yes, please take a look, it´s not bad for a mouth restauration. It also segments the region as far as i have seen. So after that we can merge it to the original video as you did with the restauration last part to keep the resolution of the orignal video.

Demo: Bildschirmfoto 2023-09-17 um 22 52 30

numz commented 10 months ago

Thanks I'll take care about this in futur update :)