aboSamoor / polyglot

Multilingual text (NLP) processing toolkit
http://polyglot-nlp.com
Other
2.31k stars 337 forks source link

language detection error in chinese #187

Open feng-1985 opened 5 years ago

feng-1985 commented 5 years ago

In the following example, it detect as traditional chinese language, but it just simplyfied chinese language:

银行本票的提示付款期限
什么是“快捷付”功能

How to solve this problem?

Additional, for the text in chinese language, can i set the language preference for it? Such as, for some sentence like "支票的提示付款期限", the simplyfied chinese is the same to traditional chinese. The language detect it as traditional chinese, but i want it be simplyfied chinese.