GlobalMaksimum / sadedegel

A General Purpose NLP library for Turkish
http://sadedegel.ai
MIT License
93 stars 13 forks source link

Add spelling correction #190

Open askarbozcan opened 3 years ago

askarbozcan commented 3 years ago

Add a spelling correction module which uses dictionary of Turkish words either with:

1- By adding SymSpell dependency and using SymSpell (https://pypi.org/project/symspellpy/) 2- By implementing Norvig's algorithm from scratch (https://norvig.com/spell-correct.html)

Furthermore, after FastText is added (#119) it can be used to select the most probable correction (as given by spelling correction algorithms above) based on the context around the word.

Similar to #143.