vi3k6i5 / flashtext

Extract Keywords from sentence or Replace keywords in sentences.
MIT License
5.58k stars 598 forks source link

Chinese and Arabic words #120

Closed RohanNayaks closed 3 years ago

RohanNayaks commented 3 years ago

I tried to train the flashtext model with the words from the language Chinese and Arabic. After I train in the keyword_processor the Chinese word : '早上好' is converted to '"早业好"' I want to know , what is that you are using to convert '早上好' into '早业好'.

I want to train the flashtext to extract the keywords for multiple languages. Please , let me know the solution .

Thank you.