drolbr / Overpass-API

A database engine to query the OpenStreetMap data.
http://overpass-api.de
GNU Affero General Public License v3.0
690 stars 90 forks source link

Latest Europe continent database indexing taking too much time #719

Open akki401 opened 3 months ago

akki401 commented 3 months ago

Hello Team, I am using overpass docker image(https://hub.docker.com/r/wiktorn/overpass-api) to launch the overpass docker service for Europe continent and the plant URL I am using is https://download.geofabrik.de/europe-latest.osm.bz2 which is latest up to date. It took more than 48 hours to do indexing and still doing indexing. Find the below docker command to start the overpass docker and EC2 hardware config. I have given diff url to update every 30 days in environment variables. My question is when I am starting the docker image it will start with latest europe continent database but when I see the logs it is considering the updates also and start doing indexing( I see update 30 days interval). Screenshot of last few lines of latest logs image

Docker command: cmd = " ".join( [ "docker", "run", "--restart=always", # starts docker after system reboot "--log-driver json-file", "--log-opt max-size=10m", "--log-opt max-file=3", "-e", "OVERPASS_META=yes", "-e", "OVERPASS_MODE=init", "-e", f"OVERPASS_PLANET_URL=file:///db/{self.region}-latest.osm.bz2", "-e", "OVERPASS_RULES_LOAD=10", # infinite areas update process. Ex: 0-always run, 5-run 5% of the time... "-e", f"OVERPASS_DIFF_URL={self._updates_url}", # https://download.geofabrik.de/europe-updates "-e", f"OVERPASS_UPDATE_SLEEP={3600 24 30}", # update every 30 days "-e", "OVERPASS_STOP_AFTER_INIT=false", "-v", f"{self._dir_overpass}/:/db", "-p", f"{self._overpass_port}:80", "-i", "-t", "-d", "--name", self._overpass_container_name, "wiktorn/overpass-api", ] ) EC2 config: Instance Size: i4i.2xlarge vCPU: 64 Instance Storage (GB): 1 x 1,875 AWS Nitro SSD Network Bandwidth (Gbps): Up to 12 EBS Bandwidth (Gbps): Up to 10

akki401 commented 3 months ago

After very long time the status of docker is unhealth and the last log statements are image

No idea why it got failed

mmd-osm commented 3 months ago

Since this docker image is maintained by a third party, we cannot help you with any issues. Please head over to https://github.com/wiktorn/Overpass-API instead.