Make tokenizer option non-case-sensitive

himkt / konoha

🌿 An easy-to-use Japanese Text Processing tool, which makes it possible to switch tokenizers with small changes of code.

https://pypi.org/project/konoha

MIT License

230 stars 24 forks source link

Closed himkt closed 5 years ago

himkt commented 5 years ago

Make WordTokenizer('KyTea') and WordTokenizer('kytea') the same.

himkt commented 5 years ago