search

twitter / twitter-korean-text

Korean tokenizer
Apache License 2.0
858 stars 173 forks source link

I want to add user-dictionary. is it possible?? #115

Open janerim opened 6 years ago

janerim commented 6 years ago

hello. I user twitter analyzer with python.

And I want to make user-dictionary. It means, when I tokenize "섬유탈취제" now, it make tokens like this. "tokens": [ "섬유(Noun: 0, 2)", "탈취(Noun: 2, 2)", "제(Noun: 4, 1)" ], but, I want make tokens like this. "tokens": [ "섬유탈취제(Noun or Compound)" ],

is it possible? if possible, how could I make this?

hohyon-ryu commented 6 years ago

Please consider migrating to https://openkoreantext.org/. https://github.com/open-korean-text/open-korean-text

We've stopped supporting twitter-korean-text.

And it's possible in open-korean-text.