pgRouting / osm2pgrouting

Import tool for OpenStreetMap data to pgRouting database
https://pgrouting.org
GNU General Public License v2.0
286 stars 113 forks source link

Killed #268

Closed Doev closed 4 years ago

Doev commented 4 years ago

Importing data always end up with "killed". What does that mean? How can I see the reason? Tables are empty.

Execution starts at: Sun Jun  7 07:42:11 2020

***************************************************
           COMMAND LINE CONFIGURATION             *
***************************************************
Filename = germany-latest.osm
Configuration file = mapconfig.xml
host = xxx.xxx.xxx.xxx
port = 5432
dbname = osm_germany
username = osm
schema= pgr
prefix =
suffix =
Drop tables
Don't create indexes
Don't add OSM nodes
***************************************************
Testing database connection: osm_germany
database connection successful: osm_germany
Connecting to the database
connection success

Dropping tables...
TABLE: pgr.ways dropped ... OK.
TABLE: pgr.ways_vertices_pgr dropped ... OK.
TABLE: pgr.pointsofinterest dropped ... OK.
TABLE: pgr.configuration dropped ... OK.
TABLE: pgr.osm_nodes dropped ... OK.
TABLE: pgr.osm_ways dropped ... OK.
TABLE: pgr.osm_relations dropped ... OK.

Creating tables...
TABLE: pgr.ways_vertices_pgr created ... OK.
TABLE: pgr.ways created ... OK.
TABLE: pgr.pointsofinterest created ... OK.
TABLE: pgr.configuration created ... OK.
Opening configuration file: mapconfig.xml
    Parsing configuration

Exporting configuration ...
  - Done
Counting lines ...
  - Done
Opening data file: germany-latest.osm   total lines: 1089047150
    Parsing data

Killed
Doev commented 4 years ago

to less RAM. Actually it needs 224GB .... still running.

Doev commented 4 years ago

398 GB

Doev commented 4 years ago

Now 443GB RAM usage. I have no idea, if it is short before its end, or will run for days. I will stop and try to reduce the size of the osm file.

Doev commented 4 years ago

I reduced the filesize from about 70 to 7GB. Removing can be done easy by osmfilter, no sed commands needed.

After a short time parsing was done and importing has started and I got a prcessbar. 33GB is needed now,