Can't build segments files

[YaroShkvorets]

After building brouter and pbfparser I'm trying to run map creation script but it doesn't seem to be working. I'm using monaco-latest.osm.pbf from geofabrik

$ ./process_pbf_planet.sh                                                        
*** OsmCutter: cut an osm map in node-tiles + a way file                         
*** PBF Parsing: C:\Users\shkvo\Documents\Projects\brouter\misc\scripts\mapcreation\monaco-latest.osm.pbf                                                        
--- waiting for more data, currentSize=561793 bytesRead=0                        
--- waiting for more data, currentSize=561793 bytesRead=0                       
--- waiting for more data, currentSize=561793 bytesRead=0                        
--- waiting for more data, currentSize=561793 bytesRead=0                        
--- waiting for more data, currentSize=561793 bytesRead=0                       
--- waiting for more data, currentSize=561793 bytesRead=0                        
--- waiting for more data, currentSize=561793 bytesRead=0                        
--- waiting for more data, currentSize=561793 bytesRead=0                        
--- waiting for more data, currentSize=561793 bytesRead=0                        
--- waiting for more data, currentSize=561793 bytesRead=0                        
--- waiting for more data, currentSize=561793 bytesRead=0                        
--- waiting for more data, currentSize=561793 bytesRead=0                        
read raw blobs: 9                                                                
parsing time (ms) =120445                                                        
records read: 50404 nodes=46461 ways=3733 rels=210 changesets=0                  
*** NodeFilter: Filter way related nodes                                         
*** WayIterator reading: ways.dat                                                
*** RelationMerger: merge relations into ways                                    
marked 1753 routes for key: route_bicycle_icn_2                                  
marked 83 routes for key: route_hiking_iwn_2                                     
*** WayIterator reading: ways.dat                                                
*** WayCutter: Soft-Cut way-data into tiles                                      
*** WayIterator reading: ways2.dat                                               
**** DenseLongMap stats ****                                                     
putCount=0                                                                       
0-bitplanes=0                                                                    
1-bitplanes=0                                                                    
2-bitplanes=0                                                                    
3-bitplanes=0                                                                   
4-bitplanes=0                                                                    
5-bitplanes=0                                                                    
6-bitplanes=0                                                                    
7-bitplanes=0                                                                   
****************************                                                    
*** WayCutter5: Soft-Cut way-data into tiles                                     
*** NodeCutter: Cut big node-tiles into 5x5 tiles                                
*** PosUnifier: Unify position values and enhance elevation                      
*** WayLinker: Format a region of an OSM map for routing

There is only one file in nodetiles directory: E0_N30.ntl

All other directories ftiles, nodes55, segments, unodes55, waytiles, waytiles55 are empty

Thoughts?

[abrensch]

sorry I recently re-worked the preprocessor for low latency.

I thought I did everything for keeping existing scripts to worked, but as I did not test that, you cannot assume that it works.

So you habe to options:

• use the old "brouter.jar" that is contained in zthe pbfparser dir for preprocessing

• I copied the production script to the git repo ( scripts/process_pbf_planet_production.sh ) If you strip the upper and the lower part, it should work for you

  There is still, however, this 2 minutes pause that the parser makes befor starting That is because I adapted the parser to read a pbf file while it is written, so there has to be some heuristic flow control.

The re-work of the preprocessor still needs to be finished, I want to eliminate most of the command line parameters and replace it by hardcoded file/dir names, as there's no use in changing them anyhow. And I want to drop compatibility with the old script - so I leave this issue her open

[YaroShkvorets]

Production script works. Thanks.

[stesie]

The inconsistency in the "old way" is file extensions. OsmCutter (now) produces .ntl files, however NodeFilter, NodeCutter & WayCutter still expect .tls and .tlf files. Hence the NodeFilter call above just ready the ways.dat file, then however not a single node tile file and hence simply emits no output to be processed in subsequent steps.

Changing both .tls and .tlf to just .ntl makes the "old way" work as well

[mjaschen]

related PRs:

• 251 (closed unmerged -> OsmCutter is deprecated; OsmFastCutter works fine)

• 267 (open -> Docker-based turn-key solution for building routing data files using the new pipeline)

[stesie]

oh, I haven't seen the PR so far, just debugged my way through the "old way" and then found this issue here :-)

... and to be honest I haven't found the "new way" before coming here, since both mapcreation.md and process_pbf_planet.sh link to it.

... anyways, in order to just "play around" the "old way" is a bit easier to get into IMHO. Actually I'm currently just playing around with adding "pseudo tags" to ways based on heatmap data I've been collecting, so I can have profiles that slightly prefer ways I've never ridden before.

And with the step-by-step approach I can just add one more level of batch processing :)

[xieyongchao2]

process_pbf_planet_production.sh The script does not execute correctly. Do you need to make some modifications? ./scan_world.sh and ./traffic_simulation.sh not existis