search

X-LANCE / UniCATS-CTX-vec2wav

[AAAI 2024] Code for CTX-vec2wav in UniCATS
https://cpdu.github.io/unicats/
122 stars 16 forks source link

Recommended text or phoneme tokenizer to use #7

Open francislata opened 1 year ago

francislata commented 1 year ago

Hi @cantabile-kwok, in the paper, there was not any recommended text or phoneme tokenizer to use. Do you have recommendations of what to use?

Thank you.

cantabile-kwok commented 1 year ago

That is a tricky thing, and I am also thinking about it. In our workflow, we used the Kaldi toolkit and a pre-defined (CMU dict-based) lexicon file to specify each word with its phone sequence. Now this may be too troublesome to use for users not familiar with it. As far as I know, there is a phonemizer g2p tool which, when built upon eSpeak, can generate accurate IPA transcriptions of given sentences. There is also a g2p_en python package which can give the CMU dict phonemes.

These might be easy to use, so you may have a try.

francislata commented 1 year ago

Thanks for that. I’ve been looking at the Coqui TTS tokenizer class, which will handle phonemization if needed. This takes care of almost everything, including text mormalization. So I’ll give it a try first and go from there. I’ll see if the g2p-en can be integrated too.

rishikksh20 commented 12 months ago

@francislata Have you used Coqui TTS tokenizer for your Unicats, is it working good ?