WorksApplications / SudachiTra

Japanese tokenizer for Transformers
Apache License 2.0
77 stars 10 forks source link

remove lowercase normalizer #25

Closed t-yamamura closed 2 years ago