Text Chunking and Newlines

[tommv]

This important, but difficult to explain - ask me if I am not clear.

Two 'granularities' are relevant when chunking the ENB reports

1. The first and coarser level is that of 'sections' corresponding to different tracks or formats
2. The second and finer level is that of 'paragraphs' corresponding to different topics

Generally, ENB writers

• Use a title followed by a newline to indicate a change of meeting and therefore a change in 1. (track or format). This is the case for all the TITLE and H1, for most of the H2 and for some of the H3)
• Use a title not followed by a newline to indicate a change of topic and therefore 2.

While tagging the tracks and formats (more urgent), we should therefore take into consideration only the titles followed by a new line.

When we'll move to the topic tagging (less urgent), we should to take into consideration all titles.

Hope this help

[rufuspollock]

@tommv could you provide an example here from one of the reports - and link to the report online or in the repo?