search

giggls / openstreetmap-carto-de

OpenStreetMap german style (a fork of openstreetmap-carto)
Other
52 stars 19 forks source link

osm2pgsql stops with "error when importing german-latest-osm.pbf" "berlin-latest.osm.pbf is running" #70

Closed QuaduxIT closed 1 year ago

QuaduxIT commented 1 year ago

With berlin-latest.osm.pbf everything is ok.

running on Ryzen 7 with 128GB RAM

Expected behavior

sudo -u renderer /usr/local/bin/osm2pgsql -G -O flex -d osm -S /osml10n/openstreetmap-carto-hstore-only-l10n.lua /trans/berlin-latest.osm.pbf

2023-02-09 21:20:31 osm2pgsql version 1.8.0 (1.8.0) 2023-02-09 21:20:31 Database version: 14.6 (Ubuntu 14.6-0ubuntu0.22.04.1) 2023-02-09 21:20:31 PostGIS version: 3.2 2023-02-09 21:21:12 Reading input files done in 40s.
2023-02-09 21:21:12 Processed 6482963 nodes in 15s - 432k/s 2023-02-09 21:21:12 Processed 1002682 ways in 24s - 42k/s 2023-02-09 21:21:12 Processed 16314 relations in 1s - 16k/s 2023-02-09 21:21:13 No marked ways (Skipping stage 2). 2023-02-09 21:21:17 Clustering table 'planet_osm_hstore_point' by geometry... 2023-02-09 21:21:17 Clustering table 'planet_osm_hstore_roads' by geometry... 2023-02-09 21:21:17 Clustering table 'planet_osm_hstore_polygon' by geometry... 2023-02-09 21:21:17 Clustering table 'planet_osm_hstore_line' by geometry... 2023-02-09 21:21:17 Creating index on table 'planet_osm_hstore_roads' ("way")... 2023-02-09 21:21:18 Analyzing table 'planet_osm_hstore_roads'... 2023-02-09 21:21:18 No indexes to create on table 'planet_osm_hstore_route'. 2023-02-09 21:21:18 Analyzing table 'planet_osm_hstore_route'... 2023-02-09 21:21:35 Creating index on table 'planet_osm_hstore_line' ("way")... 2023-02-09 21:21:38 Analyzing table 'planet_osm_hstore_line'... 2023-02-09 21:21:38 Creating index on table 'planet_osm_hstore_point' ("way")... 2023-02-09 21:21:38 Creating index on table 'planet_osm_hstore_polygon' ("way")... 2023-02-09 21:21:44 Analyzing table 'planet_osm_hstore_point'... 2023-02-09 21:21:44 Analyzing table 'planet_osm_hstore_polygon'... 2023-02-09 21:21:45 All postprocessing on table 'planet_osm_hstore_point' done in 27s. 2023-02-09 21:21:45 All postprocessing on table 'planet_osm_hstore_line' done in 21s. 2023-02-09 21:21:45 All postprocessing on table 'planet_osm_hstore_roads' done in 1s. 2023-02-09 21:21:45 All postprocessing on table 'planet_osm_hstore_polygon' done in 27s. 2023-02-09 21:21:45 All postprocessing on table 'planet_osm_hstore_route' done in 0s. 2023-02-09 21:21:45 osm2pgsql took 73s (1m 13s) overall.

Actual behavior with niedersachsen...

023-02-09 21:16:34 osm2pgsql version 1.8.0 (1.8.0) 2023-02-09 21:16:34 Database version: 14.6 (Ubuntu 14.6-0ubuntu0.22.04.1) 2023-02-09 21:16:34 PostGIS version: 3.2 Processing: Node(38252k 1416.7k/s) Way(27k 13.50k/s) Relation(0 0.0/s)free(): invalid size runde.sh: line 35: 280 Aborted sudo -u renderer /usr/local/bin/osm2pgsql -G -O flex -d osm -S /osml10n/openstreetmap-carto-hstore-only-l10n.lua /trans/niedersachsen-latest.osm.pbf

Actual behavior with germany...

2023-02-09 21:24:27 osm2pgsql version 1.8.0 (1.8.0) 2023-02-09 21:24:27 Database version: 14.6 (Ubuntu 14.6-0ubuntu0.22.04.1) 2023-02-09 21:24:27 PostGIS version: 3.2 Processing: Node(378820k 1546.2k/s) Way(0k 0.00k/s) Relation(0 0.0/s)double free or corruption (out) runde.sh: line 35: 140 Aborted sudo -u renderer /usr/local/bin/osm2pgsql -G -O flex -d osm -S /osml10n/openstreetmap-carto-hstore-only-l10n.lua /trans/germany-latest.osm.pbf

Can anybody help me ?

giggls commented 1 year ago

Why do you report this here? This is obviously not an issue of this style.

QuaduxIT commented 1 year ago

Sorry, I follow the instructions on this Install-de.md and get the error. Have you any idea where I can ask for help ? Is it an issue for osml10n ? thx

giggls commented 1 year ago

Probably is, but looks more like an osm2pgsql issue IMO.

Did make test work for you in osml10n?

However osml10n has been tested with a complete planet import (Using Debian 11. PostgreSQL 123 and osm2pgsql 1.7.).

QuaduxIT commented 1 year ago

I opened an issue on osm2pgsql ( there was a simlular error years before)

Yes the test was : 87 tests passed, 0 tests failed.

With Berlin everything is fine. After that I want to load complete German, but... I will try Debian 11 with postgres 12 and osm2pgsql 1.7. and after it I will report !

thx