spinfo / drc

Digital Romansch Chrestomathy
http://www.spinfo.phil-fak.uni-koeln.de/forschung-drc.html
8 stars 3 forks source link

Improve tokenization #139

Closed fsteeg closed 13 years ago

fsteeg commented 14 years ago

Words without special chars, special chars as words on their own.