search

WorldModelers / DART

Two Six Labs Data Acquisition & Reasoning Toolkit
0 stars 0 forks source link

PDF extraction doesn't separate some list headers from the first element of the list #5

Open azamanian opened 5 years ago

azamanian commented 5 years ago

@reynoldsm88

In the pdf corresponding to document 1dd8140b696694951eb467550dc014e9, we see:

1dd8140b696694951eb467550dc014e9

Mostly this transfers well to the cdr with double carriage returns separating the list elements (great for information extraction purposes!). However, the heading "In Numbers" is not separated to the first list element "1.69 million internally displaced people...". So extractors will erroneously assume this is all one sentence. It'd be helpful to get a double carriage return separator after "In Numbers".

pdf source is here:

https://documents.wfp.org/stellent/groups/Public/documents/ep/WFP283607.pdf?_ga=2.194812264.497798276.1538588036-841502227.1498664735

azamanian commented 5 years ago

Similar issue in

027e58cbd1c303bed8ddcfe461c53d5c

Where headers like "Education" don't get separated from the section body in the cdr.

27

Also in 34296e8b8a7d5e53a5522fc6ae22fcf0, it'd be nice to get some separation between "Highlights" and the first list element below "Highlights".