search

barrust / pyspellchecker

Pure Python Spell Checking http://pyspellchecker.readthedocs.io/en/latest/
MIT License
714 stars 164 forks source link

Ensure tokenizer uses lowercase #36

Closed barrust closed 5 years ago

barrust commented 5 years ago

Related to #34 - ensure that the provided tokenizer uses lowercase like the default tokenizer.

We should also add some tests for the tokenizer.

barrust commented 5 years ago

Resolved in version 0.4.0