Failed to process planet file

arne182 commented 4 years ago

[ ok ] osm:~# service docker start

Starting docker ... [ ok ] osm:~# docker run \
```
-e OVERPASS_META=yes \
-e OVERPASS_MODE=init \
-e OVERPASS_PLANET_URL=https://download.geofabrik.de/europe/germany/baden-
```
wuerttemberg-latest.osm.bz2 \ -e OVERPASS_DIFF_URL=http://download.geofabrik.de/europe/germany/baden-wue rttemberh-updates/ \ -e OVERPASS_RULES_LOAD=10 \ -v /big/docker/overpass_db/:/db \ -i -t \ --name overpass_bw wiktorn/overpass-api No database directory. Initializing % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 100 717M 100 717M 0 0 1708k 0 0:07:09 0:07:09 --:--:-- 1602k [======================================================================] 100% Reading XML file ...terminate called after throwing an instance of 'std::bad_alloc' what(): std::bad_alloc /app/bin/init_osm3s.sh: line 44: 15 Broken pipe bunzip2 < $PLANET_FE 16 Aborted | $EXEC_DIR/bin/update_database --db-dir=$DB_DIN Failed to process planet file

arne182 commented 4 years ago

Looks like 1GB of RAM is too little. Will try again with two

arne182 commented 4 years ago

2GB of RAM also failed. Trying 4GB.

arne182 commented 4 years ago

4GB just failed but 4GB and cgroup_enable=memory swapaccount=1 with an 8GB swap worked. For a smaller 100M file

arne182 commented 4 years ago

Would it be possible to load two regions into the same DB file?

wiktorn commented 4 years ago

Yes, it's possible. You would need to to point Overpass to extract that contains all needed regions, and then use osmium with -p in OVERPASS_PLANET_PREPROCESS to do the job for you. But this will handle only initial load, not updates. There is a small refactor needed, to handle that in update process too.

You would need also to create definitions of regions you want to extract in a file and mount it within your container.

wiktorn / Overpass-API

Failed to process planet file #37