marcotcr / lime

Lime: Explaining the predictions of any machine learning classifier
BSD 2-Clause "Simplified" License
11.54k stars 1.8k forks source link

LIME explain ability for other language - Non English #684

Open sunnyfarfetch opened 2 years ago

sunnyfarfetch commented 2 years ago

Hello, I was trying to use LIME explanation generation for other language (Bengali), a non-English language. When I see the work highlighting, the whole words are not properly highlighted. Is there any suggestion regarding how to work with it? My training data is also non-English.