Open thisandagain opened 6 years ago
Add support for simplified and traditional Chinese. This will require a modification to the strategy for tokenization of the input phrase.
https://nlp.stanford.edu/software/segmenter.shtml https://github.com/yishn/chinese-tokenizer
Add support for simplified and traditional Chinese. This will require a modification to the strategy for tokenization of the input phrase.
References
https://nlp.stanford.edu/software/segmenter.shtml https://github.com/yishn/chinese-tokenizer