Open yh1008 opened 7 years ago
the word symbol table (a.k.a. the word.txt
) file does not contain the word listed above, which is weird cause the word.txt
is supposed to be the unique words show up on text
, it is possible that the shell script cut -d ' ' -f 2- text | sed 's/ /\n/g' | sort -u > words.txt
used to generateword.txt
, fail to parse these words
We are going to bring everything in transcript to UPPER case (lexicon has all UPPER case already)
To generate G.fst I executed
which outputs the following warning:
Need to examine whether this XXX not in symbol table can be fixed (or simply does it matter)