Chinese and Japanese support

morfologik / morfologik-stemming

Tools for finite state automata construction and dictionary-based morphological dictionaries. Includes Polish stemming dictionary.

BSD 3-Clause "New" or "Revised" License

186 stars 44 forks source link

Closed rahmanusta closed 8 years ago

rahmanusta commented 8 years ago

Hi;

Does morfologic supports Chinese and Japanese languages?

dweiss commented 8 years ago

I think you mean segmentation, not stemming? If so, no, it doesn't support it. I believe LingPipe has a pre-trained HMM for segmentation of Chinese.

rahmanusta commented 8 years ago

Thank you @dweiss