search

kiselev-dv / gazetteer

OSM ElasticSearch geocoder and addresses exporter
http://osm.me
Other
99 stars 21 forks source link

corrupted output file when processing the whole planet #56

Open lfoppiano opened 6 years ago

lfoppiano commented 6 years ago

Dear developers, I've tried to process the 67Gb file from the OSM dump: planet-latest.osm.bz2

I've ran the following command: bzcat planet-latest.osm.bz2 | java -jar target/Gazetteer.jar split - none after certain a while (several hours) the process stopped but the produced file in the /data directory was corrputed. I didn't have any log output.

Have you ever tried to process such a big file?

Thank you Luca