Cross-lingual supported?

maum-ai / assem-vc

Official Code for Assem-VC @ICASSP2022

https://mindslab-ai.github.io/assem-vc/

BSD 3-Clause "New" or "Revised" License

265 stars 39 forks source link

Cross-lingual supported? #39

Open Siboooo opened 1 year ago

Siboooo commented 1 year ago

Hey, thank you for sharing your great work! I'm a student who's currently working on cross-lingual VC. Your Assem-vc framework provides excellent results in VC within single language. I'm wondering does this framework also work for cross-lingual VC? Is there any way to transform the Cotatron model to support multi-language?

junjun3518 commented 1 year ago

We did not try cross-lingual, but it seems to work with a cross-lingual setup.

To train a cross-lingual Assem-VC, a multilingual Cotatron is needed. Since training Cotatron is almost identical to training Tacotron, you need a multilingual Tacotron setup.