added unittest for testing arbitrary word segmentation

unicode-org / lstm_word_segmentation

Python code for training an LSTM model for word segmentation in Thai, Burmese, and similar languages.

Other

20 stars 9 forks source link

added unittest for testing arbitrary word segmentation #31

Closed 0saurabh0 closed 6 months ago

0saurabh0 commented 8 months ago

[ WIP ]

Due to the complexity and nuances of the Thai language, there might be scenarios not fully covered by these tests, might need
some feedback and suggestions