search

choijeongsoo / lip2speech-unit

[Interspeech 2023] Intelligible Lip-to-Speech Synthesis with Speech Units
Other
21 stars 2 forks source link

2nd stage inference #4

Closed kenxxxxx closed 3 months ago

kenxxxxx commented 3 months ago

Thanks for your contribution.

kenxxxxx commented 3 months ago

Your approach should be that the mel-spectrogram is entered into the generator along with the speech units, but I see that the speech units don't seem to be entered into the generator in the inference code for the 2nd stage. when should the speech units be input?