search

drolbr / Overpass-API

A database engine to query the OpenStreetMap data.
http://overpass-api.de
GNU Affero General Public License v3.0
693 stars 90 forks source link

Dispatcher error with "Address in use" for incorrect version #592

Open dakotabenjamin opened 3 years ago

dakotabenjamin commented 3 years ago 
File_Error Address already in use 98 /data//osm3s_v0.7.55_osm_base Unix_Socket::4
File_Error 17 File exists /data/osm_base_shadow.lock write_start:1
File_Error 17 File exists /data/osm_base_shadow.lock write_start:1

I have Overpass v0.7.56.3 running on an Ubuntu 18.04 Azure VM, and a mounted disk for the data. After installing I run 

$ home/overpass/osm3s/bin/download_clone.sh --db-dir=/data --source=http://dev.overpass-api.de/api_drolbr/ --meta=attic
$ nohup /home/overpass/osm3s/bin/dispatcher --osm-base --attic --rate-limit=5 --space=18000000000 --db-dir=/data/ >> /home/overpass/dispatcher.out &
$ nohup bash /home/overpass/osm3s/bin/fetch_osc_and_apply.sh https://planet.osm.org/replication/minute --meta=attic >> /home/overpass/fetch_osc_and_apply.out &

0.7.55 was installed previously but in a different installation dir. This has happened repeatedly after a few days of running smoothly, terminating/re-cloning the database and restarting doesn't seem to work.

mmd-osm commented 3 years ago

You should move to 0.7.56.7 first before continuing, the version you're using had some issues as described on osm talk recently.

For some reason, you seem to have some remaining pieces of the old version around. Can you clean those up first?

dakotabenjamin commented 3 years ago

Ok, I have upgraded to 0.7.56.7 with a fresh cloned database- it worked for some time but now has halted processing: https://overpass-mm.hotosm.org/api/augmented_diff_status shows 4180070.

the dispatcher output shows: 

overpass@MMOverpass:~$ tail dispatcher.out
File_Error 17 File exists /data/osm_base_shadow.lock write_start:1

fetch_osc_and_apply hasn't updated since 2020-08-24:

overpass@MMOverpass:~$ tail -n 50 fetch_osc_and_apply.out
2020-08-24 02:46:24 URL:https://planet.osm.org/replication/minute/004/164/330.state.txt [158/158] -> "/tmp/osm-3s_update_mNmNPS/004164330.state.txt" [1]
2020-08-24 02:46:25 URL:https://planet.osm.org/replication/minute/004/164/330.osc.gz [39470/39470] -> "/tmp/osm-3s_update_mNmNPS/004164330.osc.gz" [1]
https://planet.osm.org/replication/minute/004/164/331.state.txt:
2020-08-24 02:46:25 ERROR 404: Not Found.
https://planet.osm.org/replication/minute/004/164/331.osc.gz:
2020-08-24 02:46:26 ERROR 404: Not Found.
Reading XML file ... finished reading nodes. Flushing to database ...... done.
Reading XML file ... finished reading ways. Flushing to database ...... done.
Reading XML file ... finished reading relations. Flushing to database ....... done.
Update complete.
2020-08-24 02:47:31 URL:https://planet.osm.org/replication/minute/004/164/331.state.txt [158/158] -> "/tmp/osm-3s_update_9Hfe6u/004164331.state.txt" [1]
Unable to establish SSL connection.

gzip: stdin: unexpected end of file
2020-08-24 03:02:32 URL:https://planet.osm.org/replication/minute/004/164/332.state.txt [158/158] -> "/tmp/osm-3s_update_9Hfe6u/004164332.state.txt" [1]
2020-08-24 03:02:33 URL:https://planet.osm.org/replication/minute/004/164/332.osc.gz [80866/80866] -> "/tmp/osm-3s_update_9Hfe6u/004164332.osc.gz" [1]
2020-08-24 03:02:33 URL:https://planet.osm.org/replication/minute/004/164/333.state.txt [158/158] -> "/tmp/osm-3s_update_9Hfe6u/004164333.state.txt" [1]
2020-08-24 03:02:34 URL:https://planet.osm.org/replication/minute/004/164/333.osc.gz [29561/29561] -> "/tmp/osm-3s_update_9Hfe6u/004164333.osc.gz" [1]
2020-08-24 03:02:35 URL:https://planet.osm.org/replication/minute/004/164/334.state.txt [158/158] -> "/tmp/osm-3s_update_9Hfe6u/004164334.state.txt" [1]
2020-08-24 03:02:36 URL:https://planet.osm.org/replication/minute/004/164/334.osc.gz [54549/54549] -> "/tmp/osm-3s_update_9Hfe6u/004164334.osc.gz" [1]
2020-08-24 03:02:36 URL:https://planet.osm.org/replication/minute/004/164/335.state.txt [158/158] -> "/tmp/osm-3s_update_9Hfe6u/004164335.state.txt" [1]
2020-08-24 03:02:37 URL:https://planet.osm.org/replication/minute/004/164/335.osc.gz [52889/52889] -> "/tmp/osm-3s_update_9Hfe6u/004164335.osc.gz" [1]
2020-08-24 03:02:38 URL:https://planet.osm.org/replication/minute/004/164/336.state.txt [158/158] -> "/tmp/osm-3s_update_9Hfe6u/004164336.state.txt" [1]
2020-08-24 03:02:39 URL:https://planet.osm.org/replication/minute/004/164/336.osc.gz [16595/16595] -> "/tmp/osm-3s_update_9Hfe6u/004164336.osc.gz" [1]
2020-08-24 03:02:39 URL:https://planet.osm.org/replication/minute/004/164/337.state.txt [158/158] -> "/tmp/osm-3s_update_9Hfe6u/004164337.state.txt" [1]
2020-08-24 03:02:40 URL:https://planet.osm.org/replication/minute/004/164/337.osc.gz [15277/15277] -> "/tmp/osm-3s_update_9Hfe6u/004164337.osc.gz" [1]
2020-08-24 03:02:41 URL:https://planet.osm.org/replication/minute/004/164/338.state.txt [158/158] -> "/tmp/osm-3s_update_9Hfe6u/004164338.state.txt" [1]
2020-08-24 03:02:42 URL:https://planet.osm.org/replication/minute/004/164/338.osc.gz [39579/39579] -> "/tmp/osm-3s_update_9Hfe6u/004164338.osc.gz" [1]
2020-08-24 03:02:42 URL:https://planet.osm.org/replication/minute/004/164/339.state.txt [158/158] -> "/tmp/osm-3s_update_9Hfe6u/004164339.state.txt" [1]
2020-08-24 03:02:43 URL:https://planet.osm.org/replication/minute/004/164/339.osc.gz [69645/69645] -> "/tmp/osm-3s_update_9Hfe6u/004164339.osc.gz" [1]
2020-08-24 03:02:44 URL:https://planet.osm.org/replication/minute/004/164/340.state.txt [158/158] -> "/tmp/osm-3s_update_9Hfe6u/004164340.state.txt" [1]
2020-08-24 03:02:45 URL:https://planet.osm.org/replication/minute/004/164/340.osc.gz [24870/24870] -> "/tmp/osm-3s_update_9Hfe6u/004164340.osc.gz" [1]
2020-08-24 03:02:45 URL:https://planet.osm.org/replication/minute/004/164/341.state.txt [158/158] -> "/tmp/osm-3s_update_9Hfe6u/004164341.state.txt" [1]
2020-08-24 03:02:46 URL:https://planet.osm.org/replication/minute/004/164/341.osc.gz [54661/54661] -> "/tmp/osm-3s_update_9Hfe6u/004164341.osc.gz" [1]
2020-08-24 03:02:47 URL:https://planet.osm.org/replication/minute/004/164/342.state.txt [158/158] -> "/tmp/osm-3s_update_9Hfe6u/004164342.state.txt" [1]
2020-08-24 03:02:48 URL:https://planet.osm.org/replication/minute/004/164/342.osc.gz [38274/38274] -> "/tmp/osm-3s_update_9Hfe6u/004164342.osc.gz" [1]
2020-08-24 03:02:48 URL:https://planet.osm.org/replication/minute/004/164/343.state.txt [158/158] -> "/tmp/osm-3s_update_9Hfe6u/004164343.state.txt" [1]
2020-08-24 03:02:49 URL:https://planet.osm.org/replication/minute/004/164/343.osc.gz [53360/53360] -> "/tmp/osm-3s_update_9Hfe6u/004164343.osc.gz" [1]
2020-08-24 03:02:50 URL:https://planet.osm.org/replication/minute/004/164/344.state.txt [158/158] -> "/tmp/osm-3s_update_9Hfe6u/004164344.state.txt" [1]
2020-08-24 03:02:51 URL:https://planet.osm.org/replication/minute/004/164/344.osc.gz [44835/44835] -> "/tmp/osm-3s_update_9Hfe6u/004164344.osc.gz" [1]
2020-08-24 03:02:51 URL:https://planet.osm.org/replication/minute/004/164/345.state.txt [158/158] -> "/tmp/osm-3s_update_9Hfe6u/004164345.state.txt" [1]
2020-08-24 03:02:52 URL:https://planet.osm.org/replication/minute/004/164/345.osc.gz [127283/127283] -> "/tmp/osm-3s_update_9Hfe6u/004164345.osc.gz" [1]
2020-08-24 03:02:53 URL:https://planet.osm.org/replication/minute/004/164/346.state.txt [158/158] -> "/tmp/osm-3s_update_9Hfe6u/004164346.state.txt" [1]
2020-08-24 03:02:54 URL:https://planet.osm.org/replication/minute/004/164/346.osc.gz [38755/38755] -> "/tmp/osm-3s_update_9Hfe6u/004164346.osc.gz" [1]
https://planet.osm.org/replication/minute/004/164/347.state.txt:
2020-08-24 03:02:55 ERROR 404: Not Found.
https://planet.osm.org/replication/minute/004/164/347.osc.gz:
2020-08-24 03:02:55 ERROR 404: Not Found.
Reading XML file ...Parse error at line 1:
no element found
overpass@MMOverpass:~$ tail /data/fetch_osc_and_apply.log 
2020-08-24 02:43:14: updating to 4164327
2020-08-24 02:45:02: update complete 4164327
2020-08-24 02:45:02: updating from 4164327
2020-08-24 02:45:06: updating to 4164329
2020-08-24 02:46:23: update complete 4164329
2020-08-24 02:46:23: updating from 4164329
2020-08-24 02:46:26: updating to 4164330
2020-08-24 02:47:30: update complete 4164330
2020-08-24 02:47:30: updating from 4164330
2020-08-24 03:02:55: updating to 4164346