This repository contains the codes of "A Lip Sync Expert Is All You Need for Speech to Lip Generation In the Wild", published at ACM Multimedia 2020. For HD commercial model, please try out Sync Labs
I’m working on a project to lip-sync videos in French using the wav2lip model. In every result, the software seems to have created a third lip to the mouth that appears every 2 seconds. Maybe it is because I am lipsyncing in French and LSR2 has been trained for English. Does anyone know what to do? If I need a dataset tailor to french, where would I be able to get one?
This model should work fine with any language since out relies on the mel spectrograms for the input audio files. What is the resolution off your video?
I’m working on a project to lip-sync videos in French using the wav2lip model. In every result, the software seems to have created a third lip to the mouth that appears every 2 seconds. Maybe it is because I am lipsyncing in French and LSR2 has been trained for English. Does anyone know what to do? If I need a dataset tailor to french, where would I be able to get one?