Filter sentences ahead of time

clulab / eidos

Machine reading system for World Modelers

Apache License 2.0

37 stars 24 forks source link

Open BeckySharp opened 6 years ago

BeckySharp commented 6 years ago

do some grammatical-goodness checks and ignore some sentences... mixed case is a sign of bad text..

CoreNLP has a component for case correction, e.g., “THis is BAD” => “This is bad” (hopefully steal some code from there to check for this?)
Processors uses an approach to determining if a period is part of an abbrev or sent end, can we use this alg here?

BeckySharp commented 6 years ago

closes #385