search

gis-ops / docker-valhalla

This is our flexible Docker repository for the Valhalla routing engine
MIT License
228 stars 69 forks source link

Can't ingest transit #153

Closed araichev closed 2 months ago

araichev commented 2 months ago

Hi all, i'm trying unsuccessfully to run Valhalla with transit for Auckland, New Zealand. Well, Valhalla runs but not with transit, as evidenced by the log message "Writing 0 transit pbf tiles" and an isochrone about Devonport that doesn't incorporate the ferry (transit). Any idea what's happening?

I'm using the Auckland GTFS feed here and the Auckland OSM PBF extract here. And here's my command log (on Linux Mint 21).

docker run -it -e build_elevation=True -e build_time_zones=True -e build_transit=True --name valhalla -p 8002:8002 -v $PWD/gtfs_feeds:/gtfs_feeds -v $PWD/custom_files:/custom_files ghcr.io/gis-ops/docker-valhalla/valhalla

INFO: Running container with user valhalla UID 59999 and GID 59999.

WARNING: Hash not found for: /custom_files/auckland.osm.pbf!
WARNING: Requested transit data build, starting a new tile build
INFO: Found existing valhalla.json. Updating possibly missing entries.

==========================
= Building transit tiles =
==========================

2024/04/23 02:29:17.832344 [INFO] Running valhalla_ingest_transit with 16 thread(s).
2024/04/23 02:29:17.832375 [INFO] Tiling GTFS Feeds
2024/04/23 02:29:17.832408 [INFO] Writing 0 transit pbf tiles with 16 threads...
2024/04/23 02:29:17.833197 [INFO] Finished
2024/04/23 02:29:17.833223 [INFO] Stitching 0 transit tiles with 16 threads...
2024/04/23 02:29:17.833624 [INFO] Finished
2024/04/23 02:29:17.850023 [INFO] Running valhalla_convert_transit with 16 thread(s).
2024/04/23 02:29:17.850072 [INFO] Building transit network.
2024/04/23 02:29:17.850074 [INFO] No transit tiles found. Transit will not be added.
2024/04/23 02:29:17.850085 [INFO] Validating transit network.
2024/04/23 02:29:17.850149 [INFO] Transit directory not found. Transit will not be added.
INFO: Running build tiles with: /custom_files/valhalla.json /custom_files/auckland.osm.pbf

============================
= Build the initial graph. =
============================
2024/04/23 02:29:17.870372 [INFO] Running valhalla_build_tiles with 16 thread(s).
2024/04/23 02:29:17.870397 [INFO] Start stage = initialize End stage = build
2024/04/23 02:29:17.870510 [WARN] Non-empty /custom_files/valhalla_tiles/0 will be purged of tiles
2024/04/23 02:29:17.871587 [WARN] Non-empty /custom_files/valhalla_tiles/1 will be purged of tiles
2024/04/23 02:29:17.873260 [WARN] Non-empty /custom_files/valhalla_tiles/2 will be purged of tiles
2024/04/23 02:29:17.879714 [INFO] Parsing files for ways: /custom_files/auckland.osm.pbf
2024/04/23 02:29:17.879805 [INFO] Parsing ways...
2024/04/23 02:29:24.757029 [INFO] Added 889 culdesac roundabouts from 1071 candidates.
2024/04/23 02:29:24.757050 [INFO] Finished with 180164 routable ways containing 1573419 nodes
2024/04/23 02:29:24.771495 [INFO] Sorting osm access tags by way id...
2024/04/23 02:29:24.778263 [INFO] Finished
2024/04/23 02:29:24.780955 [INFO] Write OSMData to temp files
2024/04/23 02:29:24.786962 [INFO] Done
2024/04/23 02:29:24.787703 [INFO] Parsing files for relations: /custom_files/auckland.osm.pbf
2024/04/23 02:29:24.787772 [INFO] Parsing relations...
2024/04/23 02:29:25.850860 [INFO] Finished with 2570 simple turn restrictions
2024/04/23 02:29:25.850877 [INFO] Finished with 0 lane connections
2024/04/23 02:29:25.851122 [INFO] Sorting complex restrictions by from id...
2024/04/23 02:29:25.851355 [INFO] Sorting complex restrictions by to id...
2024/04/23 02:29:25.851445 [INFO] Finished
2024/04/23 02:29:25.851621 [INFO] Write OSMData to temp files
2024/04/23 02:29:25.854335 [INFO] Done
2024/04/23 02:29:25.855012 [INFO] Parsing files for nodes: /custom_files/auckland.osm.pbf
2024/04/23 02:29:25.855024 [INFO] Sorting osm way node references by node id...
2024/04/23 02:29:25.997332 [INFO] Parsing nodes...
2024/04/23 02:29:29.239568 [INFO] Finished with 1306905 nodes contained in routable ways
2024/04/23 02:29:29.239585 [INFO] Sorting osm way node references by way index and node shape index...
2024/04/23 02:29:29.395298 [INFO] Finished: max_osm_id 11839849389
2024/04/23 02:29:29.395316 [INFO] Number of nodes with refs (exits) = 439
2024/04/23 02:29:29.395318 [INFO] Number of nodes with exit_to = 0
2024/04/23 02:29:29.395323 [INFO] Number of nodes with names = 177
2024/04/23 02:29:29.395325 [INFO] Number of nodes with linguistics = 3
2024/04/23 02:29:29.395330 [INFO] Number of way refs = 0
2024/04/23 02:29:29.395332 [INFO] Number of reverse way refs = 0
2024/04/23 02:29:29.395334 [INFO] Unique Node Strings (names, refs, etc.) = 187
2024/04/23 02:29:29.395336 [INFO] Unique Strings (names, refs, etc.) = 18867
2024/04/23 02:29:29.395640 [INFO] Write OSMData to temp files
2024/04/23 02:29:29.422742 [INFO] Done
2024/04/23 02:29:29.422791 [INFO] Sort nodes spatially within each tile using nxn grids where n = 32
2024/04/23 02:29:29.422798 [INFO] Creating graph edges from ways...
2024/04/23 02:29:29.509908 [INFO] Finished with 374972 graph edges
2024/04/23 02:29:29.532859 [INFO] Sorting graph...
2024/04/23 02:29:29.604924 [INFO] Nodes processed. Sorting begin and end nodes by edge.
2024/04/23 02:29:29.657265 [INFO] Sorting begin and end nodes done. Populating edges...
2024/04/23 02:29:29.666266 [INFO] Finished with 288622 graph nodes
2024/04/23 02:29:29.670865 [INFO] Writing tile manifest to /custom_files/valhalla_tiles/tile_manifest.json
2024/04/23 02:29:29.670887 [INFO] Reclassifying_V2 link graph edges...
2024/04/23 02:29:29.710415 [INFO] Class: 0 exit count = 141
2024/04/23 02:29:29.710430 [INFO] Class: 1 exit count = 47
2024/04/23 02:29:29.710432 [INFO] Class: 2 exit count = 592
2024/04/23 02:29:29.710434 [INFO] Class: 3 exit count = 497
2024/04/23 02:29:29.710436 [INFO] Class: 4 exit count = 165
2024/04/23 02:29:29.710437 [INFO] Class: 5 exit count = 89
2024/04/23 02:29:29.710439 [INFO] Class: 6 exit count = 37
2024/04/23 02:29:29.710441 [INFO] Class: 7 exit count = 0
2024/04/23 02:29:29.721788 [INFO] Finished with 2355 link edges reclassified.  Turn channel count = 1638
2024/04/23 02:29:29.725708 [INFO] Reclassifying ferry connection graph edges...
2024/04/23 02:29:29.778972 [INFO] Finished ReclassifyFerryEdges: ferry_endpoint_count = 12, 267 edges reclassified. Failed both directions for 3 connections.
2024/04/23 02:29:29.793156 [INFO] Building 49 tiles with 16 threads...
2024/04/23 02:29:29.795256 [WARN] Admin db /custom_files/admin_data/admins.sqlite not found.  Not saving admin information.
2024/04/23 02:29:29.795272 [WARN] Admin db /custom_files/admin_data/admins.sqlite not found.  Not saving admin information.
2024/04/23 02:29:29.795447 [WARN] Admin db /custom_files/admin_data/admins.sqlite not found.  Not saving admin information.
2024/04/23 02:29:29.795481 [WARN] Admin db /custom_files/admin_data/admins.sqlite not found.  Not saving admin information.
2024/04/23 02:29:29.795551 [WARN] Admin db /custom_files/admin_data/admins.sqlite not found.  Not saving admin information.
2024/04/23 02:29:29.795591 [WARN] Admin db /custom_files/admin_data/admins.sqlite not found.  Not saving admin information.
2024/04/23 02:29:29.795600 [WARN] Admin db /custom_files/admin_data/admins.sqlite not found.  Not saving admin information.
2024/04/23 02:29:29.795652 [WARN] Admin db /custom_files/admin_data/admins.sqlite not found.  Not saving admin information.
2024/04/23 02:29:29.795713 [WARN] Admin db /custom_files/admin_data/admins.sqlite not found.  Not saving admin information.
2024/04/23 02:29:29.795727 [WARN] Admin db /custom_files/admin_data/admins.sqlite not found.  Not saving admin information.
2024/04/23 02:29:29.795774 [WARN] Admin db /custom_files/admin_data/admins.sqlite not found.  Not saving admin information.
2024/04/23 02:29:29.795835 [WARN] Admin db /custom_files/admin_data/admins.sqlite not found.  Not saving admin information.
2024/04/23 02:29:29.795912 [WARN] Admin db /custom_files/admin_data/admins.sqlite not found.  Not saving admin information.
2024/04/23 02:29:29.795994 [WARN] Admin db /custom_files/admin_data/admins.sqlite not found.  Not saving admin information.
2024/04/23 02:29:29.795994 [WARN] Admin db /custom_files/admin_data/admins.sqlite not found.  Not saving admin information.
2024/04/23 02:29:29.796098 [WARN] Admin db /custom_files/admin_data/admins.sqlite not found.  Not saving admin information.
2024/04/23 02:29:30.568156 [INFO] Finished
2024/04/23 02:29:30.568517 [INFO] Node Count = 288622
2024/04/23 02:29:30.568524 [INFO] Directed Edge Count = 749944
2024/04/23 02:29:30.568530 [INFO] EdgeInfo Count = 376414

================================
= Download the elevation tiles =
================================
2024-04-23 02:29:30,625  INFO: Downloading tile S36E175.hgt
2024-04-23 02:29:30,625  INFO: Downloading tile S36E174.hgt
2024-04-23 02:29:30,625  INFO: Downloading tile S37E173.hgt
2024-04-23 02:29:33,843  INFO: Downloaded 3 tiles. Exiting.

===============================
= Enhancing the initial graph =
===============================
2024/04/23 02:29:33.875510 [INFO] Running valhalla_build_tiles with 16 thread(s).
2024/04/23 02:29:33.875531 [INFO] Start stage = enhance End stage = cleanup
2024/04/23 02:29:33.875586 [INFO] Read OSMData unique_names from temp file
2024/04/23 02:29:33.878165 [INFO] Done
2024/04/23 02:29:33.878171 [INFO] Enhancing local graph...
2024/04/23 02:29:33.881539 [WARN] Admin db /custom_files/admin_data/admins.sqlite not found.  Not saving admin information.
2024/04/23 02:29:33.881675 [WARN] Admin db /custom_files/admin_data/admins.sqlite not found.  Not saving admin information.
2024/04/23 02:29:33.881682 [WARN] Admin db /custom_files/admin_data/admins.sqlite not found.  Not saving admin information.
2024/04/23 02:29:33.881709 [WARN] Admin db /custom_files/admin_data/admins.sqlite not found.  Not saving admin information.
2024/04/23 02:29:33.881723 [WARN] Admin db /custom_files/admin_data/admins.sqlite not found.  Not saving admin information.
2024/04/23 02:29:33.881967 [WARN] Admin db /custom_files/admin_data/admins.sqlite not found.  Not saving admin information.
2024/04/23 02:29:33.882041 [WARN] Admin db /custom_files/admin_data/admins.sqlite not found.  Not saving admin information.
2024/04/23 02:29:33.882043 [WARN] Admin db /custom_files/admin_data/admins.sqlite not found.  Not saving admin information.
2024/04/23 02:29:33.882136 [WARN] Admin db /custom_files/admin_data/admins.sqlite not found.  Not saving admin information.
2024/04/23 02:29:33.882233 [WARN] Admin db /custom_files/admin_data/admins.sqlite not found.  Not saving admin information.
2024/04/23 02:29:33.882404 [WARN] Admin db /custom_files/admin_data/admins.sqlite not found.  Not saving admin information.
2024/04/23 02:29:33.882538 [WARN] Admin db /custom_files/admin_data/admins.sqlite not found.  Not saving admin information.
2024/04/23 02:29:33.882806 [WARN] Admin db /custom_files/admin_data/admins.sqlite not found.  Not saving admin information.
2024/04/23 02:29:33.883374 [WARN] Admin db /custom_files/admin_data/admins.sqlite not found.  Not saving admin information.
2024/04/23 02:29:33.883739 [WARN] Admin db /custom_files/admin_data/admins.sqlite not found.  Not saving admin information.
2024/04/23 02:29:33.884112 [WARN] Admin db /custom_files/admin_data/admins.sqlite not found.  Not saving admin information.
2024/04/23 02:29:33.888050 [INFO] Disabled default speeds assignment from config
2024/04/23 02:29:33.888187 [INFO] Disabled default speeds assignment from config
2024/04/23 02:29:33.888251 [INFO] Disabled default speeds assignment from config
2024/04/23 02:29:33.888339 [INFO] Disabled default speeds assignment from config
2024/04/23 02:29:33.888405 [INFO] Disabled default speeds assignment from config
2024/04/23 02:29:33.888515 [INFO] Disabled default speeds assignment from config
2024/04/23 02:29:33.888521 [INFO] Disabled default speeds assignment from config
2024/04/23 02:29:33.888578 [INFO] Disabled default speeds assignment from config
2024/04/23 02:29:33.888625 [INFO] Disabled default speeds assignment from config
2024/04/23 02:29:33.888812 [INFO] Disabled default speeds assignment from config
2024/04/23 02:29:33.888935 [INFO] Disabled default speeds assignment from config
2024/04/23 02:29:33.888995 [INFO] Disabled default speeds assignment from config
2024/04/23 02:29:33.888995 [INFO] Disabled default speeds assignment from config
2024/04/23 02:29:33.889819 [INFO] Disabled default speeds assignment from config
2024/04/23 02:29:33.890042 [INFO] Disabled default speeds assignment from config
2024/04/23 02:29:33.890688 [INFO] Disabled default speeds assignment from config
2024/04/23 02:30:06.639226 [INFO] Finished with max_density 19.673302
2024/04/23 02:30:06.639251 [INFO] internal intersection = 6379
2024/04/23 02:30:06.640206 [INFO] GraphFilter - nothing to filter. Skipping...
2024/04/23 02:30:06.640225 [INFO] Transit directory not found. Transit will not be added.
2024/04/23 02:30:06.640238 [INFO] HierarchyBuilder
2024/04/23 02:30:07.344640 [INFO] Done HierarchyBuilder
2024/04/23 02:30:07.345601 [INFO] Creating shortcuts on level 1
2024/04/23 02:30:07.742390 [INFO] Finished with 9466 shortcuts superseding 63992 edges, average ~6 edges per shortcut
2024/04/23 02:30:07.742407 [INFO] Creating shortcuts on level 0
2024/04/23 02:30:07.810923 [INFO] Finished with 2940 shortcuts superseding 24476 edges, average ~8 edges per shortcut
2024/04/23 02:30:07.813012 [INFO] Adding elevation to 56 tiles with 16 threads...
2024/04/23 02:30:08.261519 [INFO] Finished
2024/04/23 02:30:08.265916 [INFO] Adding complex turn restrictions at level 2
2024/04/23 02:30:08.702391 [INFO] --Forward restrictions added: 86
2024/04/23 02:30:08.702410 [INFO] --Reverse restrictions added: 90
2024/04/23 02:30:08.702519 [INFO] Adding complex turn restrictions at level 1
2024/04/23 02:30:08.983702 [INFO] --Forward restrictions added: 88
2024/04/23 02:30:08.983728 [INFO] --Reverse restrictions added: 93
2024/04/23 02:30:08.988684 [INFO] Adding complex turn restrictions at level 0
2024/04/23 02:30:09.183661 [INFO] --Forward restrictions added: 115
2024/04/23 02:30:09.183680 [INFO] --Reverse restrictions added: 106
2024/04/23 02:30:09.183693 [INFO] Finished
2024/04/23 02:30:09.183704 [INFO] Validating, finishing and binning tiles...
2024/04/23 02:30:09.537142 [INFO] Finished
2024/04/23 02:30:09.537162 [INFO] Binning inter-tile edges...
2024/04/23 02:30:09.565471 [INFO] Finished
2024/04/23 02:30:09.565518 [WARN] Possible duplicates at level: 0 = 0
2024/04/23 02:30:09.565522 [WARN] Possible duplicates at level: 1 = 2
2024/04/23 02:30:09.565525 [WARN] Possible duplicates at level: 2 = 0
2024/04/23 02:30:09.569743 [INFO] Cleaning up temporary *.bin files within /custom_files/valhalla_tiles/
INFO: Successfully built files: /custom_files/auckland.osm.pbf
INFO: Hashing files: /custom_files/auckland.osm.pbf
INFO: Hashing file: /custom_files/auckland.osm.pbf
2850f7117667e4d49768b12e7b9581c327f6a7ed7d52eef17e71fa510977f369
2024-04-23 02:30:09,772  INFO: Finished tarring 56 tiles to /custom_files/valhalla_tiles.tar
WARNING: User valhalla is running with sudo privileges. Try building the image with a host user's UID & GID.
INFO: Found config file. Starting valhalla service!
nilsnolde commented 2 months ago

hm strange.. had a quick look and calendar.txt seems good. you could try to build from source and set the -DLOGGING_LEVEL=DEBUG to get a (much) more verbose build log to see if there's some more info that could help us.

in any case, best to open this upstream, it's a valhalla issue. gtfs still has some problems but the known ones are mostly around having stops outside the pbf extract.