OpenPecha / Botok

🏷 བོད་ཏོག [pʰøtɔk̚] Tibetan word tokenizer in Python
https://botok.readthedocs.io/
Apache License 2.0
58 stars 15 forks source link

dict like `get` method for Token object #74

Open 10zinten opened 4 years ago

10zinten commented 4 years ago
WT = WordTokenizer()
tokens = WT.tokenize(in_str)

token = tokens[0]
token.get('lemma')