Improve Japanese judgment processing.

abadojack / whatlanggo

Natural language detection library for Go

MIT License

637 stars 64 forks source link

Improve Japanese judgment processing. #6

Closed WhiteRaven777 closed 6 years ago

WhiteRaven777 commented 6 years ago

In the current process, there are cases where Japanese is also judged as Mandarin. If Hiragana or Katakana is included, even if judged as Mandarin, it is regarded as Japanese. Japanese uses Kanji (unicode.Han) in addition to Hiragana and Katakana.

abadojack commented 6 years ago

Thanks