search

gis-ops / docker-valhalla

This is our flexible Docker repository for the Valhalla routing engine
MIT License
228 stars 69 forks source link

Cryptic error, when reading transit data #119

Closed pfennig42 closed 11 months ago

pfennig42 commented 11 months ago

Hey guys,

I am trying to upgrade my valhalla with some transit data. In concrete, the area of Baden-Württemberg in Germany.

But I get an error, everytime I try to parse the gtfs data.

The short error is terminate called after throwing an instance of 'std::bad_array_new_length' what(): std::bad_array_new_length /valhalla/scripts/configure_valhalla.sh: line 210: 78 Aborted (core dumped) valhalla_build_tiles -c ${CONFIG_FILE} -s enhance ${files}

I tried different source files for the data. This error happened with this file from the transit company kvv: https://projekte.kvv-efa.de/GTFS/google_transit.zip

But also trying different files, e.g. from here: https://www.nvbw.de/open-data/fahrplandaten/fahrplandaten-nach-gebieten it is always crashing after some time with an error in the configure_valhalla.sh.

Is there any thing I missed? Or is there something I forgot to configure? I do not really know how to debug this Issue

The whole docker logs (starting at building the inital graph) are:

= Build the initial graph. =
============================
2023/08/05 18:42:08.869217 [INFO] Running valhalla_build_tiles with 6 thread(s).
2023/08/05 18:42:08.869248 [INFO] Start stage = initialize End stage = build
2023/08/05 18:42:08.873648 [INFO] Parsing files for ways: /custom_files/baden-wuerttemberg-latest.osm.pbf
2023/08/05 18:42:08.880135 [INFO] Parsing ways...
2023/08/05 18:44:32.599935 [INFO] Added 1629 culdesac roundabouts from 2682 candidates.
2023/08/05 18:44:32.599959 [INFO] Finished with 2073670 routable ways containing 14415857 nodes
2023/08/05 18:44:33.053658 [INFO] Sorting osm access tags by way id...
2023/08/05 18:44:33.211928 [INFO] Sorting pronunciation indexes by way id...
2023/08/05 18:44:33.212023 [INFO] Finished
2023/08/05 18:44:33.218539 [INFO] Write OSMData to temp files
2023/08/05 18:44:33.226615 [INFO] Done
2023/08/05 18:44:33.228176 [INFO] Parsing files for relations: /custom_files/baden-wuerttemberg-latest.osm.pbf
2023/08/05 18:44:33.228242 [INFO] Parsing relations...
2023/08/05 18:44:51.720528 [INFO] Finished with 21051 simple restrictions
2023/08/05 18:44:51.720549 [INFO] Finished with 0 lane connections
2023/08/05 18:44:51.721080 [INFO] Sorting complex restrictions by from id...
2023/08/05 18:44:51.722272 [INFO] Sorting complex restrictions by to id...
2023/08/05 18:44:51.723257 [INFO] Finished
2023/08/05 18:44:51.723569 [INFO] Write OSMData to temp files
2023/08/05 18:44:51.827237 [INFO] Done
2023/08/05 18:44:51.828678 [INFO] Parsing files for nodes: /custom_files/baden-wuerttemberg-latest.osm.pbf
2023/08/05 18:44:51.828705 [INFO] Sorting osm way node references by node id...
2023/08/05 18:44:59.206467 [INFO] Parsing nodes...
2023/08/05 18:46:08.600378 [INFO] Finished with 11508349 nodes contained in routable ways
2023/08/05 18:46:08.600400 [INFO] Sorting osm way node references by way index and node shape index...
2023/08/05 18:46:16.464043 [INFO] Finished: max_osm_id 11087067746
2023/08/05 18:46:16.464061 [INFO] Number of nodes with refs (exits) = 383
2023/08/05 18:46:16.464075 [INFO] Number of nodes with exit_to = 0
2023/08/05 18:46:16.464078 [INFO] Number of nodes with names = 961
2023/08/05 18:46:16.464081 [INFO] Number of way refs = 0
2023/08/05 18:46:16.464084 [INFO] Number of reverse way refs = 0
2023/08/05 18:46:16.464088 [INFO] Unique Node Strings (names, refs, etc.) = 618
2023/08/05 18:46:16.464091 [INFO] Unique Strings (names, refs, etc.) = 101538
2023/08/05 18:46:16.464715 [INFO] Write OSMData to temp files
2023/08/05 18:46:16.827809 [INFO] Done
2023/08/05 18:46:16.827868 [INFO] Creating graph edges from ways...
2023/08/05 18:46:17.811103 [INFO] Finished with 3809607 graph edges
2023/08/05 18:46:17.878292 [INFO] Sorting graph...
2023/08/05 18:46:19.300473 [INFO] Nodes processed. Sorting begin and end nodes by edge.
2023/08/05 18:46:20.140619 [INFO] Sorting begin and end nodes done. Populating edges...
2023/08/05 18:46:20.214214 [INFO] Finished with 2975769 graph nodes
2023/08/05 18:46:20.312705 [INFO] Writing tile manifest to /custom_files/valhalla_tiles/tile_manifest.json
2023/08/05 18:46:20.312744 [INFO] Reclassifying_V2 link graph edges...
2023/08/05 18:46:21.106785 [INFO] Class: 0 exit count = 519
2023/08/05 18:46:21.106807 [INFO] Class: 1 exit count = 754
2023/08/05 18:46:21.106820 [INFO] Class: 2 exit count = 2692
2023/08/05 18:46:21.106823 [INFO] Class: 3 exit count = 2675
2023/08/05 18:46:21.106825 [INFO] Class: 4 exit count = 1401
2023/08/05 18:46:21.106828 [INFO] Class: 5 exit count = 202
2023/08/05 18:46:21.106831 [INFO] Class: 6 exit count = 287
2023/08/05 18:46:21.106833 [INFO] Class: 7 exit count = 0
2023/08/05 18:46:21.263560 [INFO] Finished with 9502 reclassified.  Turn channel count = 5298
2023/08/05 18:46:21.317511 [INFO] Reclassifying ferry connection graph edges...
2023/08/05 18:46:22.159285 [INFO] Finished ReclassifyFerryEdges: ferry_endpoint_count = 22, 489 edges reclassified.
2023/08/05 18:46:25.635050 [INFO] Building 96 tiles with 6 threads...
2023/08/05 18:46:25.636059 [WARN] Admin db /custom_files/admin_data/admins.sqlite not found.  Not saving admin information.
2023/08/05 18:46:25.636057 [WARN] Admin db /custom_files/admin_data/admins.sqlite not found.  Not saving admin information.
2023/08/05 18:46:25.636163 [WARN] Admin db /custom_files/admin_data/admins.sqlite not found.  Not saving admin information.
2023/08/05 18:46:25.636181 [WARN] Admin db /custom_files/admin_data/admins.sqlite not found.  Not saving admin information.
2023/08/05 18:46:25.636450 [WARN] Admin db /custom_files/admin_data/admins.sqlite not found.  Not saving admin information.
2023/08/05 18:46:25.636465 [WARN] Admin db /custom_files/admin_data/admins.sqlite not found.  Not saving admin information.
2023/08/05 18:50:15.753462 [INFO] Finished
2023/08/05 18:50:15.754197 [INFO] Node Count = 2975769
2023/08/05 18:50:15.754217 [INFO] Directed Edge Count = 7619214
2023/08/05 18:50:15.754225 [INFO] EdgeInfo Count = 3828638

===============================
= Enhancing the initial graph =
===============================
2023/08/05 18:50:15.915153 [INFO] Running valhalla_build_tiles with 6 thread(s).
2023/08/05 18:50:15.915199 [INFO] Start stage = enhance End stage = cleanup
2023/08/05 18:50:15.915317 [INFO] Read OSMData unique_names from temp file
2023/08/05 18:50:15.951960 [INFO] Done
2023/08/05 18:50:15.951983 [INFO] Enhancing local graph...
2023/08/05 18:50:15.956686 [WARN] Admin db /custom_files/admin_data/admins.sqlite not found.  Not saving admin information.
2023/08/05 18:50:15.956773 [WARN] Admin db /custom_files/admin_data/admins.sqlite not found.  Not saving admin information.
2023/08/05 18:50:15.957110 [WARN] Admin db /custom_files/admin_data/admins.sqlite not found.  Not saving admin information.
2023/08/05 18:50:15.957113 [WARN] Admin db /custom_files/admin_data/admins.sqlite not found.  Not saving admin information.
2023/08/05 18:50:15.957147 [WARN] Admin db /custom_files/admin_data/admins.sqlite not found.  Not saving admin information.
2023/08/05 18:50:15.957373 [WARN] Admin db /custom_files/admin_data/admins.sqlite not found.  Not saving admin information.
2023/08/05 18:50:15.961290 [INFO] Disabled default speeds assignment from config
2023/08/05 18:50:15.962249 [INFO] Disabled default speeds assignment from config
2023/08/05 18:50:15.962281 [INFO] Disabled default speeds assignment from config
2023/08/05 18:50:15.962303 [INFO] Disabled default speeds assignment from config
2023/08/05 18:50:15.962415 [INFO] Disabled default speeds assignment from config
2023/08/05 18:50:15.964172 [INFO] Disabled default speeds assignment from config
2023/08/05 18:50:18.233964 [WARN] Exceeding maximum.  Average speed: 150
2023/08/05 18:50:31.142342 [WARN] Exceeding maximum.  Average speed: 150
2023/08/05 18:55:20.577332 [WARN] Exceeding maximum.  Average speed: 150
2023/08/05 18:55:33.630643 [WARN] Local index 8 exceeds max value of 7, returning heading of 0
2023/08/05 18:55:33.630682 [WARN] Local index 9 exceeds max value of 7, returning heading of 0
2023/08/05 18:55:33.630724 [WARN] Local index 8 exceeds max value of 7, returning heading of 0
2023/08/05 18:55:33.630732 [WARN] Local index 9 exceeds max value of 7, returning heading of 0
2023/08/05 18:55:33.630743 [WARN] Local index 8 exceeds max value of 7, returning heading of 0
2023/08/05 18:55:33.630751 [WARN] Local index 9 exceeds max value of 7, returning heading of 0
2023/08/05 18:55:33.630767 [WARN] Local index 8 exceeds max value of 7, returning heading of 0
2023/08/05 18:55:33.630784 [WARN] Local index 9 exceeds max value of 7, returning heading of 0
2023/08/05 18:55:33.630799 [WARN] Local index 8 exceeds max value of 7, returning heading of 0
2023/08/05 18:55:33.630809 [WARN] Local index 9 exceeds max value of 7, returning heading of 0
2023/08/05 18:55:33.630823 [WARN] Local index 8 exceeds max value of 7, returning heading of 0
2023/08/05 18:55:33.630830 [WARN] Local index 9 exceeds max value of 7, returning heading of 0
2023/08/05 18:55:33.630843 [WARN] Local index 8 exceeds max value of 7, returning heading of 0
2023/08/05 18:55:33.630851 [WARN] Local index 9 exceeds max value of 7, returning heading of 0
2023/08/05 18:55:33.630862 [WARN] Local index 8 exceeds max value of 7, returning heading of 0
2023/08/05 18:55:33.630873 [WARN] Local index 9 exceeds max value of 7, returning heading of 0
2023/08/05 18:55:33.630882 [WARN] Local index 8 exceeds max value of 7, returning heading of 0
2023/08/05 18:55:33.630891 [WARN] Local index 9 exceeds max value of 7, returning heading of 0
2023/08/05 18:55:33.630900 [WARN] Local index 9 exceeds max value of 7, returning heading of 0
2023/08/05 18:55:33.630907 [WARN] Local index 8 exceeds max value of 7, returning heading of 0
2023/08/05 18:55:37.440166 [WARN] Exceeding maximum.  Average speed: 150
2023/08/05 18:56:17.527306 [INFO] Finished with max_density 19.559546
2023/08/05 18:56:17.527325 [INFO] internal intersection = 13958
2023/08/05 18:56:17.527857 [INFO] GraphFilter - nothing to filter. Skipping...
2023/08/05 18:56:17.643879 [INFO] Adding 22 transit tiles to the local graph...
2023/08/05 18:56:18.480047 [WARN] Could not find connection point for in/egress near: 48.838420,8.084936
terminate called after throwing an instance of 'std::bad_array_new_length'
  what():  std::bad_array_new_length
/valhalla/scripts/configure_valhalla.sh: line 210:    78 Aborted                 (core dumped) valhalla_build_tiles -c ${CONFIG_FILE} -s enhance ${files}
pfennig42 commented 11 months ago

I didnt to my homework correctly. It is a valhalla error, and there is a similar Issue open there: https://github.com/valhalla/valhalla/issues/4238 So closing it here