Create a WhitespaceTokenizer (or maybe a generic RegexBasedTokenizer)

google-code-export / dkpro-core-asl

Automatically exported from code.google.com/p/dkpro-core-asl

0 stars 0 forks source link

Open GoogleCodeExporter opened 9 years ago

GoogleCodeExporter commented 9 years ago

Create a WhitespaceTokenizer (or maybe a generic RegexBasedTokenizer).

Original issue reported on code.google.com by richard.eckart on 4 Dec 2014 at 11:36