search

anothermartz / Easy-Wav2Lip

Colab for making Wav2Lip high quality and easy to use
495 stars 76 forks source link

Support for frames without face #26

Open ChoOo7 opened 4 months ago

ChoOo7 commented 4 months ago

Hello

I have seen there is a version of inference that allow to have frame without face

Here a thread about it

https://github.com/Rudrabha/Wav2Lip/issues/532

And some edited code https://raw.githubusercontent.com/Rudrabha/Wav2Lip/master/inference.py

Could it be possible to integrate it into your project ?

Thanks

Have a good day

anothermartz commented 3 months ago

I believe Easy-Wav2Lip already handles frames without a face as I've personally experienced some black frames in a video and it just going ahead anyway through them.

The only exception would be if the video starts without a detected face, I believe it does require the first frame to have a face.

Perhaps I can make something that just plays the video as is for a clip that may start with the subject facing the other way or coming into frame after a few seconds, this will be a decent amount of work for quite edge case scenarios that can be avoided using traditional video editors, but I'll have a go at it at some point.