search

choijeongsoo / lip2speech-unit

[Interspeech 2023] Intelligible Lip-to-Speech Synthesis with Speech Units
Other
25 stars 2 forks source link

Training problems using Vox #15

Closed cwhm123 closed 4 days ago

cwhm123 commented 1 week ago

Can this model be trained using VoxCeleb2? I see that its preprocessing method is similar to LRE3, but there are issues with label.list. VoxCeleb2 does not have label.list. How can this be addressed

choijeongsoo commented 4 days ago

You could use dummy text for label.list since our model doesn't use label data. I’ll check and update the code to remove the dependency when time allows.

cwhm123 commented 4 days ago

OK Thank you for your reply