search

ufal / korektor

Statistical spell- and (occasional) grammar-checker.
lindat.mff.cuni.cz/services/korektor
BSD 2-Clause "Simplified" License
17 stars 4 forks source link

Improve tokenizer #5

Open loganathanspr opened 9 years ago

loganathanspr commented 9 years ago

Tokenizer should be improved.... For example: '.' at name initials are considered sentence terminal symbols.