chinese tts with some english words

espnet / espnet

End-to-End Speech Processing Toolkit

https://espnet.github.io/espnet/

Apache License 2.0

8.38k stars 2.17k forks source link

chinese tts with some english words #3105

Closed animebing closed 1 year ago

animebing commented 3 years ago

How to do chinese tts for texts with some english words which is very common these days? There are some difficulties I have met:

there is not tts dataset with both chinese and english.
whether I can just use chinese tts model to do the work.

mudong0419 commented 3 years ago

Any update? I have the same problem.

kan-bayashi commented 3 years ago

Sorry for the late reply. I don't know such a dataset. One possibility is to

Concatenate English and Mandarin dataset
Apply different G2P for English and Mandarin
Make a mixed token list (English phoneme + Mandarin phoneme)
Train the multi-speaker model with concatenated dataset + mixed tokens

animebing commented 3 years ago

@mudong0419 I have not solved the problem, I just find a github repo BigCiDian which can be used to combine chinese and english phoneme together.

mudong0419 commented 3 years ago

@animebing Thanks for your information. I find a github Multilingual_Text_to_Speech, but it doesn't support English.

stale[bot] commented 2 years ago

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.