Third lip/set of tooth - Githubissues

Rudrabha / Wav2Lip

This repository contains the codes of "A Lip Sync Expert Is All You Need for Speech to Lip Generation In the Wild", published at ACM Multimedia 2020. For HD commercial model, please try out Sync Labs

https://synclabs.so

10.18k stars 2.19k forks source link

Third lip/set of tooth #530

Open jules-t opened 1 year ago

jules-t commented 1 year ago

I’m working on a project to lip-sync videos in French using the wav2lip model. In every result, the software seems to have created a third lip to the mouth that appears every 2 seconds. Maybe it is because I am lipsyncing in French and LSR2 has been trained for English. Does anyone know what to do? If I need a dataset tailor to french, where would I be able to get one?

Akash-Jariwala commented 1 year ago

Same thing is happening when I am syncing hindi language

Elsaam2y commented 1 year ago

This model should work fine with any language since out relies on the mel spectrograms for the input audio files. What is the resolution off your video?