Open mpolinsky opened 2 years ago
We don't seem to be removing punctuation anywhere. Likely the model is assembling a summary from two parts of the article, one of which isn't the end of a sentence and the other is. In this case it would be a shortcoming of the model on that article chunk with particular parameters. Will have to investigate further.
...though that doesn't address the second case where the period is spaced awkwardly. Could also be the model but will investigate.
Periods are space separated on both sides and when sentences end with a quote there is no period inside or outside the quotes.
Example of both problems:
The war has wreaked havoc on the so-called "breadbasket of Europe" Ukraine and Russia together account for over a quarter of the world's world's wheat exports .