Open fishfree opened 4 weeks ago
There is indeed no chinese_mfa tokenizer model in this list. However, the class ChineseTokenizer has been already implemented here as the japanese tokenizer does, which can be downloaded by runningmfa model download tokenizer japanese_mfa.
class ChineseTokenizer
mfa model download tokenizer japanese_mfa
There is indeed no chinese_mfa tokenizer model in this list. However, the
class ChineseTokenizerhas been already implemented here as the japanese tokenizer does, which can be downloaded by runningmfa model download tokenizer japanese_mfa.