synesthesiam
commented
3 years ago Hi @ccoreilly, thanks for offering to volunteer!
When adding a new language, my first step is to add the phonemes to gruut-ipa. These should be IPA, and I usually just use a Wikipedia page.
If you can manually map the CMU phonemes to IPA, that would be great. If you follow the convention here for English, it will be possible for gruut-ipa to convert between the CMU and IPA phonemes automatically.
I have also seen you have extracted g2p models from espeak-ng, how could I do so?
I created a small script for this. I start by creating a list of words, usually just the words from my lexicon plus a list of frequent words in the language (I have one for Catalan). Make sure to lower-case and de-duplicate the words. Then I create the espeak-ng lexicon like this:
./espeak_word.sh < words.txt > lexicon.espeak.txtAfter that, converting it to a database is straightforward:
python3 -m gruut.lexicon2db --casing lower --lexicon lexicon.espeak.txt --database espeak/lexicon.dbI train separate g2p models for IPA and espeak-ng phonemes. See below for instructions on that, and let me know if you have any questions :slightly_smiling_face:
G2P
Recent versions of gruut aren't using Phonetisaurus at runtime anymore to reduce the runtime dependencies. I'm hoping to add support for reading the g2p FSTs in pure Python, but for now I'm using a different framework.
Training still needs Phonetisuarus, however, for initial alignment of the corpus. If you're using my phonetisaurus Python package, you can get this when you train a model:
phonetisaurus train --corpus g2p.corpus --model g2p.fst lexicon.txtThe g2p.corpus file contains the alignments for all words in the lexicon. You use this to train a model in my new framework like this:
python3 -m gruut.g2p train --corpus g2p.corpus --output g2p/model.crf
ccoreilly
mlrober
I would like to contribute by adding support for the catalan language to gruut (and gruut-ipa / ipa2kaldi) but I am not sure about the g2p model.
I have a phonetisaurus g2p model which outputs CMU phonemes and the corresponding dictionary, would that suffice or should the model output IPA phonemes? I could maybe manually map the CMU phonemes to IPA and retrain the model.
I have also seen you have extracted g2p models from espeak-ng, how could I do so? Or have you converted a lexicon to its IPA phonetic representation with espeak and then trained a g2p model based on that?