Mapping of Bundesblatt documents to the canonical file organization

[simon-clematide]

• Everything that is published on the same date goes into an issue
• Every article of an issue (available as a separate PDF) is turned into a logical article within the issue.
• Article segmentation: No proper segmentation is available now (eventually, there is a special marker in the tetml output). As a simple initial segmentation, always start from the first page (even if there is material from a preceding article on the same page, which will then be included into the following article)
  • if an article a ends on the same page where the next article b starts, a will be shortened and its material will be added in front of b.

[aflueckiger]

Create page images

• supplements are not shown in the official page numbering
• more than one article can be on the same page (same physical page appears in two different pdf)
• some articles don't follow the regular page numbering. The length of the article categories "Berichte", "Beilagen", "Extrabeilagen", "Inserate" is always assumed as 1 and their first page points to the page where the previous article ends. Internally, each category is numbered separately (printed page number).

todos:

• [x] sort article info file
• python script taking article info file and ouputs new tsv file with:
  • [x] year
  • [x] month
  • [x] day
  • [x] edition (always "a")
  • [x] pdf path
  • [x] article_docid
  • [x] impresso physical page number (after one issue the counter is reset to zero)
  • [x] pdf physical page count (check "make file" when the last page with meta data has changed during 1999, before minus 1 page)
  • [x] pdf internal physical page number