OpenTalker / video-retalking

[SIGGRAPH Asia 2022] VideoReTalking: Audio-based Lip Synchronization for Talking Head Video Editing In the Wild
https://opentalker.github.io/video-retalking/
Apache License 2.0
6.02k stars 895 forks source link

Need to be able to lipsync videos having some frames having no Face #229

Closed kalpesh-maru closed 2 months ago

kalpesh-maru commented 3 months ago

If there are some frames having no face in video, we should be able to skip that frame and retain it in final video, this issue was raised in original code of Wav2Lip and is been solved, But there is no fix yet in this code.

kalpesh-maru commented 2 months ago

SOLVED: I was able to get around this with few code changes, Please merge these changes in your code. (inference_utils.py, inference.py and alignment_stit.py) Download files from below link https://video-dubbing.s3.ap-south-1.amazonaws.com/video-retalker-noFace-fix/

zzqwdwd commented 2 months ago

Certainly, I'm sorry, but it seems that this link cannot be opened. Would you like me to send a new one?

kalpesh-maru commented 2 months ago

Please try this,

https://video-dubbing.s3.ap-south-1.amazonaws.com/video-retalker-noFace-fix/noFaceFix.zip

On Mon, 8 Apr 2024 at 15:04, zzqwdwd @.***> wrote:

Certainly, I'm sorry, but it seems that this link cannot be opened. Would you like me to send a new one?

— Reply to this email directly, view it on GitHub https://github.com/OpenTalker/video-retalking/issues/229#issuecomment-2042294446, or unsubscribe https://github.com/notifications/unsubscribe-auth/BAGXCW5SKSEDABG4C7E4JJ3Y4JQDHAVCNFSM6AAAAABFWPMYEKVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDANBSGI4TINBUGY . You are receiving this because you modified the open/close state.Message ID: @.***>

zzqwdwd commented 2 months ago

It's OK!Thank you very much!

Please try this, https://video-dubbing.s3.ap-south-1.amazonaws.com/video-retalker-noFace-fix/noFaceFix.zip On Mon, 8 Apr 2024 at 15:04, zzqwdwd @.> wrote: Certainly, I'm sorry, but it seems that this link cannot be opened. Would you like me to send a new one? — Reply to this email directly, view it on GitHub <#229 (comment)>, or unsubscribe https://github.com/notifications/unsubscribe-auth/BAGXCW5SKSEDABG4C7E4JJ3Y4JQDHAVCNFSM6AAAAABFWPMYEKVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDANBSGI4TINBUGY . You are receiving this because you modified the open/close state.Message ID: @.>

It's OK!Thank you very much!