Open wannaphong opened 6 years ago
Try
>>> from wordcut import Wordcut >>> wordcut = Wordcut.bigthai() >>> print(wordcut.tokenize("จุ๋มสบายดีไหม")) ['จ', 'ุ๋ม', 'สบาย', 'ดี', 'ไหม']
Many (most?) wordcutters have this 'bug': if the order is consonant, tone-sign, top/bottom-vowel, it is not recognized, because the word lists only have the proper order (consonant, top/bottom-vowel, tone-sign).
Try