louismullie / treat

Natural language processing framework for Ruby.
Other
1.37k stars 128 forks source link

Stanford parser and named entity tagger should accept tokenized sentences #16

Closed louismullie closed 11 years ago

louismullie commented 12 years ago

Currently, they only accept untokenized sentences and raise a warning if a tokenized sentence is provided.

louismullie commented 11 years ago

This has now been relaxed for the named entity tagger.

louismullie commented 11 years ago

https://github.com/louismullie/treat/commit/fe7f97afd7948bbee43d9335ac648518a902c10d