OpenPecha / Botok

🏷 བོད་ཏོག [pʰøtɔk̚] Tibetan word tokenizer in Python
https://botok.readthedocs.io/
Apache License 2.0
58 stars 15 forks source link

[Feature] Classify all PUNCTs into left and right #94

Open 10zinten opened 1 year ago

10zinten commented 1 year ago

https://github.com/OpenPecha/Botok/blob/master/botok/resources/bo_uni_table.csv