vseloved / cl-nlp

Common Lisp NLP toolset
Other
219 stars 28 forks source link

Fix tokenizer tests #10

Closed dmsurti closed 9 years ago

dmsurti commented 9 years ago

Change test data to have only single sentences as per the current word tokenizer contract.

Related to: #7, add tests if handlers are added.