search

buruzaemon / natto

A Tasty Ruby Binding with MeCab
BSD 2-Clause "Simplified" License
143 stars 16 forks source link

Enhancements to tokenization for boundary constraint parsing #34

Closed buruzaemon closed 9 years ago

buruzaemon commented 9 years ago

Fixes for behavior for handling tokenization when whitespace chars are at the start or end of tokens in boundary constraint parsing.