Open lfoppiano opened 1 year ago
When we process paragraphs and the output are sentence-based, we need the sentence offsets to be included in the output.
With the sentence offsets we can easily re-match the spans offsets back to the original paragraphs.
E.g. Spaces between sentences are usually lost in the sentence split.
When we process paragraphs and the output are sentence-based, we need the sentence offsets to be included in the output.
With the sentence offsets we can easily re-match the spans offsets back to the original paragraphs.
E.g. Spaces between sentences are usually lost in the sentence split.