Open zby opened 5 months ago
I had similar missing fragments when trying to parse https://data.consilium.europa.eu/doc/document/ST-5662-2024-INIT/en/ - mostly titles. But it is long and takes a lot of time to parse.
Currently the library is configured to use some heuristics to try to append a title to a section. If nothing is found it drops it since stubs are undesirable come query time. We may do more experimentation here.
I will look into the failing doc.
See my comment in #40
I tried to parse: https://www.pzu.pl/_fileserver/item/1540593
The saved output does not contain for example:
The output has:
and the entire fragment is missing.