search

omniscale / imposm2

Imports OpenStreetMap data into geo databases
http://imposm.org
Apache License 2.0
116 stars 24 forks source link

segfault at internal.so #43

Open navidata opened 9 years ago

navidata commented 9 years ago

Hello!

During importing of europe-latest.osm.pbf from geofabrik, imposm freezes and my dmesg messages say:

segfault at 7f649ae40040 ip 00007f64b540ecce sp 00007fff31635fe0 error 4 in internal.so[7f64b540a000+a000]

i use latest imposm from github.

Do you have any clue why this may happen?

best regards

olt commented 9 years ago

Can you upgrade imposm.parser to 1.0.6. It includes a fix for a segfault. https://pypi.python.org/pypi/imposm.parser

navidata commented 9 years ago

I used also imposm parser 1.0.7a from github but without success. This segfault appear to be random - 1 import per 3-4 tries is successful. Import on smaller extract (like one country pbf file) seem to work fine.

groupnet commented 9 years ago

Exactly the same problem for me: europe-latest.osm.pbf from geofabrik gives same segfault, smaller country extracts work. Tried imposm.parser 1.0.6 and 1.0.7 - same issue with both versions.

hhoeth commented 9 years ago

I've got the same problem, running Ubuntu 14.04.1 LTS and packages installed through the package manager.

Initially I had the imposm.parser problem during "--read", too, but upgraded imposm-parser to 1.0.7a from github. That fixed that issue (segfault in OSMPBF.so).

The internal.so segfault on the other hand occurs during "--write", not in the "--read" phase. In my case, it happened about four hours into the "--write" of a planet import.

groupnet commented 9 years ago

Have you already upgraded to imposum 2.6.0 (https://pypi.python.org/pypi/imposm) released on the 10th of January 2015? I successfully imported an Europe extract with the cobination of: imposum 2.6.0 + imposum.parser 1.0.7

hhoeth commented 9 years ago

No, still on 2.0.5. I'll try imposm 2.6.0 and report back.

navidata commented 9 years ago

I'm halfway to importing europe-latest using imposm 2.6.0 and so far, so good :)

navidata commented 9 years ago

Hi! I was able to successfully import whole planet-osm using imposm 2.6.0. I suppose this bug is fixed.

hhoeth commented 9 years ago

My planet import was successful, too (imposm-2.6.1a and imposm-parser-1.0.7a from github). Thanks so much!