This repository contains the codes of "A Lip Sync Expert Is All You Need for Speech to Lip Generation In the Wild", published at ACM Multimedia 2020. For HD commercial model, please try out Sync Labs
def get_segmented_mels(self, spec, start_frame):
............
for i in range(start_frame_num, start_frame_num + syncnet_T):
m = self.crop_audio_window(spec, i - 2)
We got the 5 audio segmentations from current frame_num - 2 to frame_num + 2.
Hi @prajwalkr,
After checking the code released. I have an issue that: In wav2lip_train.py:L92:
We got the 5 audio segmentations from current
frame_num - 2
toframe_num + 2
.But the image frame data loading in wav2lip_train.py#L47-L57
We see the image frame is collecting from current
current frame_num
tocurrent frame_num + 5
.It is a kind of mismatching, right? Or my misunderstanding?
Thanks again for your excellent work.
BR.