sentence tokenizer drops punctuation

learntextvis / textkit

Command line tool for manipulating and analyzing text

MIT License

28 stars 6 forks source link

Closed iros closed 8 years ago

iros commented 8 years ago

An input like

Hello world! I love you.

Turns into: ['Hello World', 'I love you']

Fix incoming! Opening here for tracking.

iros commented 8 years ago

Fixed in last PR