pnoll1 / osmand_map_creation

OSM data + open address data compiled for use in OSMAnd
GNU General Public License v3.0
79 stars 2 forks source link

Multiple versions of objects in PBF file #21

Closed pnoll1 closed 2 years ago

pnoll1 commented 3 years ago

Florida: Node ID twice in input. Maybe you are using a history or change file? This command expects the input file to be ordered: First nodes in order of ID, then ways in order of ID, then relations in order of ID.

Similar to #5 .

pnoll1 commented 3 years ago

Texas: log fails to show anything between output_osm and obf building: writing osm file for us/tx/falls.vrt writing osm file for us/tx/peApr 25, 2021 6:59:36 PM net.osmand.util.IndexBatchCreator generateIndex WARNING: ------------------------------------------- Apr 25, 2021 6:59:36 PM net.osmand.util.IndexBatchCreator generateIndex WARNING: ----------- Generate us_tx_northeast_alpha.osm.pbf

texas pbf appears to have finished merge: 707M Apr 25 18:58 projects/osmand_map_creation/osmand_osm/osm/us/tx/us_tx_alpha.osm.pbf slices were not created successfully(73 is size of empty file): INFO: Task loading_file/home/pat/projects/osmand_map_creation/osmand_osm/us_tx_northeast_alpha.osm.pbf: work total has changed to 73

running --quality check gives no errors for the file running --slice returns errors: ./processing_worldwide.py us:tx --slice us:tx Master List Created Node ID twice in input. Maybe you are using a history or change file? This command expects the input file to be ordered: First nodes in order of ID, then ways in order of ID, then relations in order of ID.

Node ID twice in input. Maybe you are using a history or change file? This command expects the input file to be ordered: First nodes in order of ID, then ways in order of ID, then relations in order of ID.

Node ID twice in input. Maybe you are using a history or change file? This command expects the input file to be ordered: First nodes in order of ID, then ways in order of ID, then relations in order of ID.

Node ID twice in input. Maybe you are using a history or change file? This command expects the input file to be ordered: First nodes in order of ID, then ways in order of ID, then relations in order of ID.

pnoll1 commented 3 years ago

slice command throws error, but is not attached to ready_to_move so files are moved anyways. address by setting ready_to_move to false on failure.

multiple versions quality check is passing when it shouldn't. osmium fileinfo for tx and fl shows multiple_versions true. Code was checking for string when value is boolean.

pnoll1 commented 3 years ago

quality check fixed in bbbe3dd9820181fb9ec878fc4952914689c708b4

geofabrik extracts do not have multiple versions. Issue is most likely in pg2osm.

pnoll1 commented 3 years ago

florida: added data appears twice in pbf file. Files from pg2osm appear correct. Issue has to be in merge function.

pnoll1 commented 3 years ago

tested with florida. string creation in merge function doesn't create doubles. Merge function itself seems fine and running merge by itself on dev computer with input data from build run returns file without multiple versions...

pnoll1 commented 3 years ago

First run each month fails, rerunning with same commands will finish successfully.

pnoll1 commented 2 years ago

This has not been an issue since switching to new hardware.