Open devikasondhi opened 6 years ago
Hello,
I'm not sure if treating newline character as a sentence breaker is a valid way to go about. Consider input like: "Hey,\n I'm still reading."
Shouldn't this qualify as a single sentence? The sentence tokenizer splits this into two, which I feel shouldn't be the case:
Text("Hey,\n I'm still reading.").sentences [Sentence("Hey,"), Sentence("I'm still reading.")]
Am I missing something?
Thanks.
Hello,
I'm not sure if treating newline character as a sentence breaker is a valid way to go about. Consider input like: "Hey,\n I'm still reading."
Shouldn't this qualify as a single sentence? The sentence tokenizer splits this into two, which I feel shouldn't be the case:
Am I missing something?
Thanks.