Rudrabha / Wav2Lip

This repository contains the codes of "A Lip Sync Expert Is All You Need for Speech to Lip Generation In the Wild", published at ACM Multimedia 2020. For HD commercial model, please try out Sync Labs
https://synclabs.so
10.65k stars 2.27k forks source link

HD Output with Live Demo #585

Open mvoodarla opened 11 months ago

mvoodarla commented 11 months ago

Hey folks - really love Wav2Lip, but just like everyone else, I wish it had commercial usage rights and produced higher quality output.

Just thought I'd share this if it's interesting. It's the best quality we've been able to achieve (though it's not Wav2Lip). It's also much faster than other approaches like the open source video-retalking repo but still maintains a great level of quality. I've attached a link to a demo you can try + sample output below!

https://www.sievedata.com/functions/sieve/video_retalking

https://github.com/Rudrabha/Wav2Lip/assets/11367688/f064e1f2-90e1-4ce4-9ec3-9b2c4bcbd4ea

P.S. I work at the company that built this demo. Hope we can open-source all the code very very soon!

wallezen commented 10 months ago

that's cool! do you have any plans to open source it now? @mvoodarla

mvoodarla commented 10 months ago

yes! we've found a couple more improvements we are still in the process of making. but after we do that + clean up the code we will.