impresso / federal-gazette

0 stars 0 forks source link

Paragraph Segmentation #8

Open aflueckiger opened 5 years ago

aflueckiger commented 5 years ago

The paragraph segmentation by Tet is sometimes of poor quality. An erroneous segmentation may cause problems for downstream tasks as the end of the paragraph is usually assumed to be the end of a sentence. We need to build some ad hoc measures to change the segmentation of Tet.