This repository contains the codes of "A Lip Sync Expert Is All You Need for Speech to Lip Generation In the Wild", published at ACM Multimedia 2020. For HD commercial model, please try out Sync Labs
First of all, I'm really appreciate this work on the Accurate Lip Sync model.
My question is. in the wav2lip model/Face_decoder_block, in the first Conv2d, the output channel is 512, but Next ConvTranspose takes 1024 input channels. which I didn't understand quite well, and how it is possible.
First of all, I'm really appreciate this work on the Accurate Lip Sync model. My question is. in the wav2lip model/Face_decoder_block, in the first Conv2d, the output channel is 512, but Next ConvTranspose takes 1024 input channels. which I didn't understand quite well, and how it is possible.
`self.face_decoder_blocks = nn.ModuleList([ nn.Sequential(Conv2d(512, 512, kernel_size=1, stride=1, padding=0),),
Sorry for this newbie question, It will be really helpful for me if you help me to understand this. Thanks in advance.