search

matt-yml / pk

PK's Public system to track issues and update on work
0 stars 0 forks source link

Reverse GEO Code lookup inaccuracy #46

Closed matt-yml closed 1 year ago

matt-yml commented 2 years ago

User noted reverse geocode lookup for a gym is incorrect multiple times since they started tracking it. The (lat,lon) are correct but the wrong street and city are shown.

[7:50 PM]mattle: nah thanks for the heads up. i'll take a look [7:52 PM]mattle: i did upgrade the geolocation server today so it's probably related to that [7:52 PM]Mattfal5747: Oh ok word, makes sense! [7:53 PM]Mattfal5747: All the other gyms I track currently are correct [7:56 PM]mattle: any chance you know if the lat/lon are correct? (35.910227, -79.045599) [7:57 PM]Mattfal5747: Just checked IITC, lat and long are good

Image

8:00 PM]Mattfal5747: This is from yesterday, was saying the gym is on Fordham which is also not correct

Image

matt-yml commented 2 years ago

Possibly related to recent nominatim 4.0->4.1 upgrade. Reverse lookup provided consistent results per this update at least. 

This XML file does not appear to have any style information associated with it. The document tree is shown below.
<reversegeocode timestamp="Wed, 19 Oct 22 00:28:15 +0000" attribution="Data © OpenStreetMap contributors, ODbL 1.0. http://www.openstreetmap.org/copyright" querystring="lat=35.910227&lon=-79.045599">
<result place_id="1404418" osm_type="relation" osm_id="2882828" ref="University of North Carolina at Chapel Hill" lat="35.90503535" lon="-79.04775326525107" boundingbox="35.8933498,35.9164642,-79.0923215,-79.0269224" place_rank="30" address_rank="30">University of North Carolina, Berryhill Drive, Rose Walk, Weatherhill, Carrboro, Orange County, North Carolina, 27510, United States</result>
<addressparts>
<amenity>University of North Carolina</amenity>
<road>Berryhill Drive</road>
<neighbourhood>Rose Walk</neighbourhood>
<hamlet>Weatherhill</hamlet>
<town>Carrboro</town>
<county>Orange County</county>
<state>North Carolina</state>
<ISO3166-2-lvl4>US-NC</ISO3166-2-lvl4>
<postcode>27510</postcode>
<country>United States</country>
<country_code>us</country_code>
</addressparts>
</reversegeocode>

Will trigger another update and see if correct address is found. https://nominatim.org/release-docs/4.1.0/admin/Update/#updating-nominatim

Setting to update "once" instead of "continuous" so daily updates are done at 05:30 America/New_York time. https://github.com/mediagis/nominatim-docker/tree/master/4.1#general-parameters

matt-yml commented 2 years ago

update log:

nominatim  | 2022-10-19T00:56:11.368486447Z + tailpid=0
nominatim  | 2022-10-19T00:56:11.368515129Z + replicationpid=0
nominatim  | 2022-10-19T00:56:11.368540876Z + trap stopServices SIGTERM TERM INT
nominatim  | 2022-10-19T00:56:11.368607184Z + /app/config.sh
nominatim  | 2022-10-19T00:56:11.372338306Z + id nominatim
nominatim  | 2022-10-19T00:56:11.373279719Z + useradd -m -p '<redacted>' nominatim
nominatim  | 2022-10-19T00:56:11.396970490Z + IMPORT_FINISHED=/var/lib/postgresql/14/main/import-finished
nominatim  | 2022-10-19T00:56:11.396986062Z + '[' '!' -f /var/lib/postgresql/14/main/import-finished ']'
nominatim  | 2022-10-19T00:56:11.397025238Z + chown -R nominatim:nominatim /nominatim
nominatim  | 2022-10-19T00:56:11.397863314Z + service postgresql start
nominatim  | 2022-10-19T00:56:11.433830825Z  * Starting PostgreSQL 14 database server
nominatim  | 2022-10-19T00:56:13.620065080Z    ...done.
nominatim  | 2022-10-19T00:56:13.620167969Z + cd /nominatim
nominatim  | 2022-10-19T00:56:13.620179380Z + sudo -E -u nominatim nominatim refresh --website --functions
nominatim  | 2022-10-19T00:56:13.771594811Z 2022-10-18 20:56:13: Using project directory: /nominatim
nominatim  | 2022-10-19T00:56:13.812944198Z 2022-10-18 20:56:13: Create functions
nominatim  | 2022-10-19T00:56:18.423778410Z 2022-10-18 20:56:18: Setting up website directory at /nominatim/website
nominatim  | 2022-10-19T00:56:18.468341354Z + service apache2 start
nominatim  | 2022-10-19T00:56:18.472836087Z  * Starting Apache httpd web server apache2
nominatim  | 2022-10-19T00:56:18.513010691Z AH00558: apache2: Could not reliably determine the server's fully qualified domain name, using 172.28.0.9. Set the 'ServerName' directive globally to suppress this message
nominatim  | 2022-10-19T00:56:19.522010439Z  * 
nominatim  | 2022-10-19T00:56:19.522164936Z + '[' https://download.geofabrik.de/north-america/us/north-carolina-updates/ '!=' '' ']'
nominatim  | 2022-10-19T00:56:19.522173377Z + '[' '' '!=' true ']'
nominatim  | 2022-10-19T00:56:19.522177630Z + sudo -E -u nominatim nominatim replication --project-dir /nominatim --init
nominatim  | 2022-10-19T00:56:19.657350086Z 2022-10-18 20:56:19: Using project directory: /nominatim
nominatim  | 2022-10-19T00:56:19.724039730Z 2022-10-18 20:56:19: Initialising replication updates
nominatim  | 2022-10-19T00:56:24.096037917Z 2022-10-18 20:56:24: Updates initialised at sequence 3490 (2022-10-17 13:08:51+00:00)
nominatim  | 2022-10-19T00:56:24.096051597Z 2022-10-18 20:56:24: Create functions
nominatim  | 2022-10-19T00:56:24.284555585Z starting replication once
nominatim  | 2022-10-19T00:56:24.284556379Z + '[' once == continuous ']'
nominatim  | 2022-10-19T00:56:24.284585370Z + '[' once == once ']'
nominatim  | 2022-10-19T00:56:24.284587701Z + echo 'starting replication once'
nominatim  | 2022-10-19T00:56:24.284683373Z + replicationpid=98
nominatim  | 2022-10-19T00:56:24.284735265Z + sudo -E -u nominatim nominatim replication --project-dir /nominatim --once
nominatim  | 2022-10-19T00:56:24.284747477Z + tailpid=99
nominatim  | 2022-10-19T00:56:24.284765026Z + echo 'Warm database caches for search and reverse queries'
nominatim  | 2022-10-19T00:56:24.284778805Z + sudo -E -u nominatim nominatim admin --warm
nominatim  | 2022-10-19T00:56:24.284769689Z Warm database caches for search and reverse queries
nominatim  | 2022-10-19T00:56:24.284824719Z + tail -Fv /var/log/postgresql/postgresql-14-main.log /var/log/apache2/access.log /var/log/apache2/error.log /var/log/replication.log
nominatim  | 2022-10-19T00:56:24.285330835Z ==> /var/log/postgresql/postgresql-14-main.log <==
nominatim  | 2022-10-19T00:56:24.285338229Z 2022-10-19 00:56:11.541 UTC [36] LOG:  starting PostgreSQL 14.5 (Ubuntu 14.5-0ubuntu0.22.04.1) on x86_64-pc-linux-gnu, compiled by gcc (Ubuntu 11.2.0-19ubuntu1) 11.2.0, 64-bit
nominatim  | 2022-10-19T00:56:24.285341054Z 2022-10-19 00:56:11.541 UTC [36] LOG:  listening on IPv4 address "0.0.0.0", port 5432
nominatim  | 2022-10-19T00:56:24.285343915Z 2022-10-19 00:56:11.541 UTC [36] LOG:  listening on IPv6 address "::", port 5432
nominatim  | 2022-10-19T00:56:24.285345800Z 2022-10-19 00:56:11.543 UTC [36] LOG:  listening on Unix socket "/var/run/postgresql/.s.PGSQL.5432"
nominatim  | 2022-10-19T00:56:24.285347476Z 2022-10-19 00:56:11.546 UTC [37] LOG:  database system was shut down at 2022-10-19 00:56:01 UTC
nominatim  | 2022-10-19T00:56:24.285349121Z 2022-10-19 00:56:11.551 UTC [36] LOG:  database system is ready to accept connections
nominatim  | 2022-10-19T00:56:24.285350633Z 
nominatim  | 2022-10-19T00:56:24.285352222Z ==> /var/log/apache2/access.log <==
nominatim  | 2022-10-19T00:56:24.285353709Z 
nominatim  | 2022-10-19T00:56:24.285354978Z ==> /var/log/apache2/error.log <==
nominatim  | 2022-10-19T00:56:24.285356408Z [Wed Oct 19 00:56:18.538915 2022] [mpm_prefork:notice] [pid 81] AH00163: Apache/2.4.52 (Ubuntu) configured -- resuming normal operations
nominatim  | 2022-10-19T00:56:24.285357971Z [Wed Oct 19 00:56:18.538953 2022] [core:notice] [pid 81] AH00094: Command line: '/usr/sbin/apache2'
nominatim  | 2022-10-19T00:56:24.285359511Z 
nominatim  | 2022-10-19T00:56:24.285360885Z ==> /var/log/replication.log <==
nominatim  | 2022-10-19T00:56:24.413318262Z 2022-10-18 20:56:24: Using project directory: /nominatim
nominatim  | 2022-10-19T00:56:24.413338851Z 2022-10-18 20:56:24: Warming database caches
nominatim  | 2022-10-19T00:56:25.285464466Z 2022-10-18 20:56:24: Using project directory: /nominatim
nominatim  | 2022-10-19T00:56:27.285650023Z 
nominatim  | 2022-10-19T00:56:27.285665394Z ==> /var/log/apache2/access.log <==
nominatim  | 2022-10-19T00:56:27.285669259Z 192.168.1.20 - - [19/Oct/2022:00:56:27 +0000] "GET /reverse?format=json&lat=35.7927238900846&lon=-78.66305449371377 HTTP/1.1" 200 922 "-" "axios/0.27.2"
nominatim  | 2022-10-19T00:56:28.285839950Z 192.168.1.20 - - [19/Oct/2022:00:56:27 +0000] "GET /reverse?format=json&lat=35.86129395429453&lon=-78.71188047558805 HTTP/1.1" 200 928 "-" "axios/0.27.2"
nominatim  | 2022-10-19T00:56:29.285925489Z 
nominatim  | 2022-10-19T00:56:29.285946888Z ==> /var/log/replication.log <==
nominatim  | 2022-10-19T00:56:29.285951386Z 2022-10-18 20:56:29  osm2pgsql version 1.6.0
nominatim  | 2022-10-19T00:56:29.285954288Z 2022-10-18 20:56:29  Database version: 14.5 (Ubuntu 14.5-0ubuntu0.22.04.1)
nominatim  | 2022-10-19T00:56:29.285957336Z 2022-10-18 20:56:29  PostGIS version: 3.2
nominatim  | 2022-10-19T00:56:29.285966141Z 2022-10-18 20:56:29  Parsing gazetteer style file '/usr/local/etc/nominatim/import-full.style'.
nominatim  | 2022-10-19T00:56:31.286127629Z 
Processing: Node(40k 40.0k/s) Way(1k 1.00k/s) Relation(0 0.0/s)
Processing: Node(40k 40.0k/s) Way(3k 3.00k/s) Relation(10 10.0/s)

2022-10-18 20:56:31  Reading input files done in 2s.
nominatim  | 2022-10-19T00:56:31.286147133Z 2022-10-18 20:56:31    Processed 40317 nodes in 0s - 40k/s
nominatim  | 2022-10-19T00:56:31.286150096Z 2022-10-18 20:56:31    Processed 3349 ways in 1s - 3k/s
nominatim  | 2022-10-19T00:56:31.286151834Z 2022-10-18 20:56:31    Processed 61 relations in 1s - 61/s
nominatim  | 2022-10-19T00:56:32.286226023Z 
nominatim  | 2022-10-19T00:56:32.286250468Z ==> /var/log/apache2/access.log <==
nominatim  | 2022-10-19T00:56:32.286256184Z 192.168.1.20 - - [19/Oct/2022:00:56:32 +0000] "GET /reverse?format=json&lat=35.41006282825773&lon=-80.57851875504505 HTTP/1.1" 200 1011 "-" "axios/0.27.2"
nominatim  | 2022-10-19T00:56:34.286434956Z 
nominatim  | 2022-10-19T00:56:34.286459667Z ==> /var/log/replication.log <==
nominatim  | 2022-10-19T00:56:34.286464614Z 2022-10-18 20:56:33  Done postprocessing on table 'planet_osm_nodes' in 0s
nominatim  | 2022-10-19T00:56:34.286466533Z 2022-10-18 20:56:33  Done postprocessing on table 'planet_osm_ways' in 0s
nominatim  | 2022-10-19T00:56:34.286468516Z 2022-10-18 20:56:33  Done postprocessing on table 'planet_osm_rels' in 0s
nominatim  | 2022-10-19T00:56:34.286470343Z 2022-10-18 20:56:33  osm2pgsql took 4s overall.
nominatim  | 2022-10-19T00:56:34.286471953Z 2022-10-18 20:56:34: Starting indexing rank (0 to 4) using 1 threads
nominatim  | 2022-10-19T00:56:34.286473523Z 2022-10-18 20:56:34: Starting rank 1 (using batch size 1)
nominatim  | 2022-10-19T00:56:34.286475049Z 2022-10-18 20:56:34: Done 0/0 in 0 @ 0.000 per second - FINISHED rank 1
nominatim  | 2022-10-19T00:56:34.286476857Z 
nominatim  | 2022-10-19T00:56:34.286478297Z 2022-10-18 20:56:34: Starting rank 2 (using batch size 1)
nominatim  | 2022-10-19T00:56:34.286479834Z 2022-10-18 20:56:34: Done 0/0 in 0 @ 0.000 per second - FINISHED rank 2
nominatim  | 2022-10-19T00:56:34.286481424Z 
nominatim  | 2022-10-19T00:56:34.286482854Z 2022-10-18 20:56:34: Starting rank 3 (using batch size 1)
nominatim  | 2022-10-19T00:56:34.286484457Z 2022-10-18 20:56:34: Done 0/0 in 0 @ 0.000 per second - FINISHED rank 3
nominatim  | 2022-10-19T00:56:34.286486041Z 
nominatim  | 2022-10-19T00:56:34.286487510Z 2022-10-18 20:56:34: Starting rank 4 (using batch size 1)
nominatim  | 2022-10-19T00:56:34.286489140Z 2022-10-18 20:56:34: Done 0/0 in 0 @ 0.000 per second - FINISHED rank 4
nominatim  | 2022-10-19T00:56:34.286490696Z 
nominatim  | 2022-10-19T00:56:34.286492089Z 2022-10-18 20:56:34: Starting indexing boundaries using 1 threads
nominatim  | 2022-10-19T00:56:34.286493662Z 2022-10-18 20:56:34: Starting boundaries rank 4 (using batch size 1)
nominatim  | 2022-10-19T00:56:34.286496222Z 2022-10-18 20:56:34: Done 0/0 in 0 @ 0.000 per second - FINISHED boundaries rank 4
nominatim  | 2022-10-19T00:56:34.286503615Z 
nominatim  | 2022-10-19T00:56:34.286510418Z 2022-10-18 20:56:34: Starting boundaries rank 5 (using batch size 1)
nominatim  | 2022-10-19T00:56:34.286512130Z 2022-10-18 20:56:34: Done 0/0 in 0 @ 0.000 per second - FINISHED boundaries rank 5
nominatim  | 2022-10-19T00:56:34.286513732Z 
nominatim  | 2022-10-19T00:56:34.286515100Z 2022-10-18 20:56:34: Starting boundaries rank 6 (using batch size 1)
nominatim  | 2022-10-19T00:56:34.286516623Z 2022-10-18 20:56:34: Done 0/0 in 0 @ 0.000 per second - FINISHED boundaries rank 6
nominatim  | 2022-10-19T00:56:34.286518201Z 
nominatim  | 2022-10-19T00:56:34.286519663Z 2022-10-18 20:56:34: Starting boundaries rank 7 (using batch size 1)
nominatim  | 2022-10-19T00:56:34.286521249Z 2022-10-18 20:56:34: Done 0/0 in 0 @ 0.000 per second - FINISHED boundaries rank 7
nominatim  | 2022-10-19T00:56:34.286522867Z 
nominatim  | 2022-10-19T00:56:34.286524303Z 2022-10-18 20:56:34: Starting boundaries rank 8 (using batch size 1)
nominatim  | 2022-10-19T00:56:34.286525790Z 2022-10-18 20:56:34: Done 0/0 in 0 @ 0.000 per second - FINISHED boundaries rank 8
nominatim  | 2022-10-19T00:56:34.286527324Z 
nominatim  | 2022-10-19T00:56:34.286528702Z 2022-10-18 20:56:34: Starting boundaries rank 9 (using batch size 1)
nominatim  | 2022-10-19T00:56:34.286530307Z 2022-10-18 20:56:34: Done 0/0 in 0 @ 0.000 per second - FINISHED boundaries rank 9
nominatim  | 2022-10-19T00:56:34.286531891Z 
nominatim  | 2022-10-19T00:56:34.286533339Z 2022-10-18 20:56:34: Starting boundaries rank 10 (using batch size 1)
nominatim  | 2022-10-19T00:56:34.286534942Z 2022-10-18 20:56:34: Done 0/0 in 0 @ 0.000 per second - FINISHED boundaries rank 10
nominatim  | 2022-10-19T00:56:34.286536574Z 
nominatim  | 2022-10-19T00:56:34.286538793Z 2022-10-18 20:56:34: Starting boundaries rank 11 (using batch size 1)
nominatim  | 2022-10-19T00:56:34.286540489Z 2022-10-18 20:56:34: Done 0/0 in 0 @ 0.000 per second - FINISHED boundaries rank 11
nominatim  | 2022-10-19T00:56:34.286542019Z 
nominatim  | 2022-10-19T00:56:34.286543425Z 2022-10-18 20:56:34: Starting boundaries rank 12 (using batch size 1)
nominatim  | 2022-10-19T00:56:35.286464490Z 2022-10-18 20:56:34: Done 0/0 in 0 @ 0.000 per second - FINISHED boundaries rank 12
nominatim  | 2022-10-19T00:56:35.286483721Z 
nominatim  | 2022-10-19T00:56:35.286487524Z 2022-10-18 20:56:34: Starting boundaries rank 13 (using batch size 1)
nominatim  | 2022-10-19T00:56:35.286489672Z 2022-10-18 20:56:34: Done 0/0 in 0 @ 0.000 per second - FINISHED boundaries rank 13
nominatim  | 2022-10-19T00:56:35.286491979Z 
nominatim  | 2022-10-19T00:56:35.286493824Z 2022-10-18 20:56:34: Starting boundaries rank 14 (using batch size 1)
nominatim  | 2022-10-19T00:56:35.286495577Z 2022-10-18 20:56:34: Done 0/0 in 0 @ 0.000 per second - FINISHED boundaries rank 14
nominatim  | 2022-10-19T00:56:35.286497538Z 
nominatim  | 2022-10-19T00:56:35.286499392Z 2022-10-18 20:56:34: Starting boundaries rank 15 (using batch size 1)
nominatim  | 2022-10-19T00:56:35.286501188Z 2022-10-18 20:56:34: Done 0/0 in 0 @ 0.000 per second - FINISHED boundaries rank 15
nominatim  | 2022-10-19T00:56:35.286503137Z 
nominatim  | 2022-10-19T00:56:35.286504831Z 2022-10-18 20:56:34: Starting boundaries rank 16 (using batch size 1)
nominatim  | 2022-10-19T00:56:35.286512022Z 2022-10-18 20:56:34: Done 0/0 in 0 @ 0.000 per second - FINISHED boundaries rank 16
nominatim  | 2022-10-19T00:56:35.286514158Z 
nominatim  | 2022-10-19T00:56:35.286515798Z 2022-10-18 20:56:34: Starting boundaries rank 17 (using batch size 1)
nominatim  | 2022-10-19T00:56:35.286517723Z 2022-10-18 20:56:34: Done 0/0 in 0 @ 0.000 per second - FINISHED boundaries rank 17
nominatim  | 2022-10-19T00:56:35.286525390Z 
nominatim  | 2022-10-19T00:56:35.286528083Z 2022-10-18 20:56:34: Starting boundaries rank 18 (using batch size 1)
nominatim  | 2022-10-19T00:56:35.286531389Z 2022-10-18 20:56:34: Done 0/0 in 0 @ 0.000 per second - FINISHED boundaries rank 18
nominatim  | 2022-10-19T00:56:35.286534618Z 
nominatim  | 2022-10-19T00:56:35.286536452Z 2022-10-18 20:56:34: Starting boundaries rank 19 (using batch size 1)
nominatim  | 2022-10-19T00:56:35.286538220Z 2022-10-18 20:56:34: Done 0/0 in 0 @ 0.000 per second - FINISHED boundaries rank 19
nominatim  | 2022-10-19T00:56:35.286540004Z 
nominatim  | 2022-10-19T00:56:35.286541801Z 2022-10-18 20:56:34: Starting boundaries rank 20 (using batch size 1)
nominatim  | 2022-10-19T00:56:35.286543641Z 2022-10-18 20:56:34: Done 0/0 in 0 @ 0.000 per second - FINISHED boundaries rank 20
nominatim  | 2022-10-19T00:56:35.286545492Z 
nominatim  | 2022-10-19T00:56:35.286547166Z 2022-10-18 20:56:34: Starting boundaries rank 21 (using batch size 1)
nominatim  | 2022-10-19T00:56:35.286548910Z 2022-10-18 20:56:34: Done 0/0 in 0 @ 0.000 per second - FINISHED boundaries rank 21
nominatim  | 2022-10-19T00:56:35.286550679Z 
nominatim  | 2022-10-19T00:56:35.286552259Z 2022-10-18 20:56:34: Starting boundaries rank 22 (using batch size 1)
nominatim  | 2022-10-19T00:56:35.286554001Z 2022-10-18 20:56:34: Done 0/0 in 0 @ 0.000 per second - FINISHED boundaries rank 22
nominatim  | 2022-10-19T00:56:35.286555953Z 
nominatim  | 2022-10-19T00:56:35.286557649Z 2022-10-18 20:56:34: Starting boundaries rank 23 (using batch size 1)
nominatim  | 2022-10-19T00:56:35.286560372Z 2022-10-18 20:56:34: Done 0/0 in 0 @ 0.000 per second - FINISHED boundaries rank 23
nominatim  | 2022-10-19T00:56:35.286562255Z 
nominatim  | 2022-10-19T00:56:35.286563852Z 2022-10-18 20:56:34: Starting boundaries rank 24 (using batch size 1)
nominatim  | 2022-10-19T00:56:35.286565646Z 2022-10-18 20:56:34: Done 0/0 in 0 @ 0.000 per second - FINISHED boundaries rank 24
nominatim  | 2022-10-19T00:56:35.286567432Z 
nominatim  | 2022-10-19T00:56:35.286569012Z 2022-10-18 20:56:34: Starting boundaries rank 25 (using batch size 1)
nominatim  | 2022-10-19T00:56:35.286571604Z 2022-10-18 20:56:34: Done 0/0 in 0 @ 0.000 per second - FINISHED boundaries rank 25
nominatim  | 2022-10-19T00:56:35.286573575Z 
nominatim  | 2022-10-19T00:56:35.286575233Z 2022-10-18 20:56:34: Starting indexing rank (5 to 25) using 1 threads
nominatim  | 2022-10-19T00:56:35.286577062Z 2022-10-18 20:56:34: Starting rank 5 (using batch size 1)
nominatim  | 2022-10-19T00:56:35.286578876Z 2022-10-18 20:56:34: Done 0/0 in 0 @ 0.000 per second - FINISHED rank 5
nominatim  | 2022-10-19T00:56:35.286580630Z 
nominatim  | 2022-10-19T00:56:35.286582240Z 2022-10-18 20:56:34: Starting rank 6 (using batch size 1)
nominatim  | 2022-10-19T00:56:35.286586430Z 2022-10-18 20:56:34: Done 0/0 in 0 @ 0.000 per second - FINISHED rank 6
nominatim  | 2022-10-19T00:56:35.286588505Z 
nominatim  | 2022-10-19T00:56:35.286590196Z 2022-10-18 20:56:34: Starting rank 7 (using batch size 1)
nominatim  | 2022-10-19T00:56:35.286591977Z 2022-10-18 20:56:34: Done 0/0 in 0 @ 0.000 per second - FINISHED rank 7
nominatim  | 2022-10-19T00:56:35.286593804Z 
nominatim  | 2022-10-19T00:56:35.286595409Z 2022-10-18 20:56:34: Starting rank 8 (using batch size 1)
nominatim  | 2022-10-19T00:56:35.286597143Z 2022-10-18 20:56:34: Done 0/0 in 0 @ 0.000 per second - FINISHED rank 8
nominatim  | 2022-10-19T00:56:35.286598881Z 
nominatim  | 2022-10-19T00:56:35.286600469Z 2022-10-18 20:56:34: Starting rank 9 (using batch size 1)
nominatim  | 2022-10-19T00:56:35.286603085Z 2022-10-18 20:56:34: Done 0/0 in 0 @ 0.000 per second - FINISHED rank 9
nominatim  | 2022-10-19T00:56:35.286607194Z 
nominatim  | 2022-10-19T00:56:35.286609621Z 2022-10-18 20:56:34: Starting rank 10 (using batch size 1)
nominatim  | 2022-10-19T00:56:35.286611543Z 2022-10-18 20:56:34: Done 0/0 in 0 @ 0.000 per second - FINISHED rank 10
nominatim  | 2022-10-19T00:56:35.286613586Z 
nominatim  | 2022-10-19T00:56:35.286615390Z 2022-10-18 20:56:34: Starting rank 11 (using batch size 1)
nominatim  | 2022-10-19T00:56:35.286617133Z 2022-10-18 20:56:34: Done 0/0 in 0 @ 0.000 per second - FINISHED rank 11
nominatim  | 2022-10-19T00:56:35.286618913Z 
nominatim  | 2022-10-19T00:56:35.286620714Z 2022-10-18 20:56:34: Starting rank 12 (using batch size 1)
nominatim  | 2022-10-19T00:56:35.286622596Z 2022-10-18 20:56:34: Done 0/0 in 0 @ 0.000 per second - FINISHED rank 12
nominatim  | 2022-10-19T00:56:35.286624468Z 
nominatim  | 2022-10-19T00:56:35.286626269Z 2022-10-18 20:56:34: Starting rank 13 (using batch size 1)
nominatim  | 2022-10-19T00:56:35.286628007Z 2022-10-18 20:56:34: Done 0/0 in 0 @ 0.000 per second - FINISHED rank 13
nominatim  | 2022-10-19T00:56:35.286629816Z 
nominatim  | 2022-10-19T00:56:35.286631404Z 2022-10-18 20:56:34: Starting rank 14 (using batch size 1)
nominatim  | 2022-10-19T00:56:35.286633142Z 2022-10-18 20:56:34: Done 0/0 in 0 @ 0.000 per second - FINISHED rank 14
nominatim  | 2022-10-19T00:56:35.286635022Z 
nominatim  | 2022-10-19T00:56:35.286636856Z 2022-10-18 20:56:34: Starting rank 15 (using batch size 1)
nominatim  | 2022-10-19T00:56:35.286638664Z 2022-10-18 20:56:34: Done 0/0 in 0 @ 0.000 per second - FINISHED rank 15
nominatim  | 2022-10-19T00:56:35.286640431Z 
nominatim  | 2022-10-19T00:56:35.286642721Z 2022-10-18 20:56:34: Starting rank 16 (using batch size 1)
nominatim  | 2022-10-19T00:56:35.286645577Z 2022-10-18 20:56:34: Done 1/1 in 0 @ 3.863 per second - FINISHED rank 16
nominatim  | 2022-10-19T00:56:35.286648637Z 
nominatim  | 2022-10-19T00:56:35.286651570Z 2022-10-18 20:56:34: Starting rank 17 (using batch size 1)
nominatim  | 2022-10-19T00:56:35.286654650Z 2022-10-18 20:56:34: Done 0/0 in 0 @ 0.000 per second - FINISHED rank 17
nominatim  | 2022-10-19T00:56:35.286656600Z 
nominatim  | 2022-10-19T00:56:35.286658549Z 2022-10-18 20:56:34: Starting rank 18 (using batch size 1)
nominatim  | 2022-10-19T00:56:35.286662725Z 2022-10-18 20:56:34: Done 0/0 in 0 @ 0.000 per second - FINISHED rank 18
nominatim  | 2022-10-19T00:56:35.286664666Z 
nominatim  | 2022-10-19T00:56:35.286666283Z 2022-10-18 20:56:34: Starting rank 19 (using batch size 1)
nominatim  | 2022-10-19T00:56:35.286668815Z 2022-10-18 20:56:34: Done 0/0 in 0 @ 0.000 per second - FINISHED rank 19
nominatim  | 2022-10-19T00:56:35.286671681Z 
nominatim  | 2022-10-19T00:56:35.286674366Z 2022-10-18 20:56:34: Starting rank 20 (using batch size 1)
nominatim  | 2022-10-19T00:56:35.286677043Z 2022-10-18 20:56:34: Done 1/1 in 0 @ 26.616 per second - FINISHED rank 20
nominatim  | 2022-10-19T00:56:35.286680231Z 
nominatim  | 2022-10-19T00:56:35.286682979Z 2022-10-18 20:56:34: Starting rank 21 (using batch size 1)
nominatim  | 2022-10-19T00:56:35.286685414Z 2022-10-18 20:56:34: Done 0/0 in 0 @ 0.000 per second - FINISHED rank 21
nominatim  | 2022-10-19T00:56:35.286688268Z 
nominatim  | 2022-10-19T00:56:35.286690552Z 2022-10-18 20:56:34: Starting rank 22 (using batch size 1)
nominatim  | 2022-10-19T00:56:35.286692770Z 2022-10-18 20:56:35: Done 8/8 in 0 @ 37.702 per second - FINISHED rank 22
nominatim  | 2022-10-19T00:56:35.286695441Z 
nominatim  | 2022-10-19T00:56:35.286697892Z 2022-10-18 20:56:35: Starting rank 23 (using batch size 1)
nominatim  | 2022-10-19T00:56:35.286700724Z 2022-10-18 20:56:35: Done 0/0 in 0 @ 0.000 per second - FINISHED rank 23
nominatim  | 2022-10-19T00:56:35.286706140Z 
nominatim  | 2022-10-19T00:56:35.286708824Z 2022-10-18 20:56:35: Starting rank 24 (using batch size 1)
nominatim  | 2022-10-19T00:56:35.286711929Z 2022-10-18 20:56:35: Done 0/0 in 0 @ 0.000 per second - FINISHED rank 24
nominatim  | 2022-10-19T00:56:35.286714618Z 
nominatim  | 2022-10-19T00:56:35.286717218Z 2022-10-18 20:56:35: Starting rank 25 (using batch size 1)
nominatim  | 2022-10-19T00:56:35.286719811Z 2022-10-18 20:56:35: Done 0/0 in 0 @ 0.000 per second - FINISHED rank 25
nominatim  | 2022-10-19T00:56:35.286722627Z 
nominatim  | 2022-10-19T00:56:35.286725184Z 2022-10-18 20:56:35: Starting indexing rank (26 to 30) using 1 threads
nominatim  | 2022-10-19T00:56:35.286728287Z 2022-10-18 20:56:35: Starting rank 26 (using batch size 1)
nominatim  | 2022-10-19T00:56:37.286642855Z 2022-10-18 20:56:37: Done 230 in 2 @ 114.177 per second - rank 26 ETA (seconds): 2.43
nominatim  | 2022-10-19T00:56:38.286713195Z 2022-10-18 20:56:38: Done 344 in 2 @ 118.058 per second - rank 26 ETA (seconds): 1.39
nominatim  | 2022-10-19T00:56:39.286888331Z 2022-10-18 20:56:38: Done 462 in 3 @ 123.710 per second - rank 26 ETA (seconds): 0.37
nominatim  | 2022-10-19T00:56:39.286910227Z 2022-10-18 20:56:39: Done 508/508 in 3 @ 128.657 per second - FINISHED rank 26
nominatim  | 2022-10-19T00:56:39.286913324Z 
nominatim  | 2022-10-19T00:56:39.286914918Z 2022-10-18 20:56:39: Starting rank 27 (using batch size 1)
nominatim  | 2022-10-19T00:56:40.286993926Z 2022-10-18 20:56:39: Done 55/55 in 0 @ 132.587 per second - FINISHED rank 27
nominatim  | 2022-10-19T00:56:40.287012516Z 
nominatim  | 2022-10-19T00:56:40.287015710Z 2022-10-18 20:56:39: Starting rank 28 (using batch size 1)
nominatim  | 2022-10-19T00:56:40.287022067Z 2022-10-18 20:56:39: Done 0/0 in 0 @ 0.000 per second - FINISHED rank 28
nominatim  | 2022-10-19T00:56:40.287023956Z 
nominatim  | 2022-10-19T00:56:40.287025352Z 2022-10-18 20:56:39: Starting rank 29 (using batch size 1)
nominatim  | 2022-10-19T00:56:40.287026875Z 2022-10-18 20:56:39: Done 0/0 in 0 @ 0.000 per second - FINISHED rank 29
nominatim  | 2022-10-19T00:56:40.287028551Z 
nominatim  | 2022-10-19T00:56:40.287030123Z 2022-10-18 20:56:39: Starting rank 30 (using batch size 20)
nominatim  | 2022-10-19T00:56:42.287258547Z 2022-10-18 20:56:41: Done 480 in 2 @ 229.618 per second - rank 30 ETA (seconds): 0.68
nominatim  | 2022-10-19T00:56:42.287287428Z 2022-10-18 20:56:42: Done 637/637 in 2 @ 250.107 per second - FINISHED rank 30
nominatim  | 2022-10-19T00:56:42.287293518Z 
nominatim  | 2022-10-19T00:56:42.287296364Z 2022-10-18 20:56:42: Starting rank 0 (using batch size 1)
nominatim  | 2022-10-19T00:56:43.287389966Z 
nominatim  | 2022-10-19T00:56:43.287409352Z ==> /var/log/apache2/access.log <==
nominatim  | 2022-10-19T00:56:43.287412785Z 192.168.1.20 - - [19/Oct/2022:00:56:42 +0000] "GET /reverse?format=json&lat=35.79385953042311&lon=-78.63433260341793 HTTP/1.1" 200 960 "-" "axios/0.27.2"
nominatim  | 2022-10-19T00:56:43.287414909Z 192.168.1.20 - - [19/Oct/2022:00:56:42 +0000] "GET /reverse?format=json&lat=35.90940069646115&lon=-79.06993415338899 HTTP/1.1" 200 1018 "-" "axios/0.27.2"
nominatim  | 2022-10-19T00:56:43.287417055Z 
nominatim  | 2022-10-19T00:56:43.287418507Z ==> /var/log/replication.log <==
nominatim  | 2022-10-19T00:56:43.287420039Z 2022-10-18 20:56:42: Done 41/41 in 0 @ 60.130 per second - FINISHED rank 0
nominatim  | 2022-10-19T00:56:43.287421528Z 
nominatim  | 2022-10-19T00:56:43.287422960Z 2022-10-18 20:56:42: Starting interpolation lines (location_property_osmline) (using batch size 20)
nominatim  | 2022-10-19T00:56:43.287424662Z 2022-10-18 20:56:42: Done 0/0 in 0 @ 0.000 per second - FINISHED interpolation lines (location_property_osmline)
nominatim  | 2022-10-19T00:56:43.287426316Z 
nominatim  | 2022-10-19T00:56:43.287427698Z 2022-10-18 20:56:42: Starting indexing postcodes using 1 threads
nominatim  | 2022-10-19T00:56:43.287429213Z 2022-10-18 20:56:42: Starting postcodes (location_postcode) (using batch size 20)
nominatim  | 2022-10-19T00:56:43.287430732Z 2022-10-18 20:56:42: Done 0/0 in 0 @ 0.000 per second - FINISHED postcodes (location_postcode)
nominatim  | 2022-10-19T00:56:43.287432255Z 
nominatim  | 2022-10-19T00:56:43.287433856Z 2022-10-18 20:56:42: Update completed. Import: 0:00:06. Indexing: 0:00:08 Total: 0:00:15. Remaining backlog: 4:35:18.
nominatim  | 2022-10-19T00:56:53.288388455Z 
nominatim  | 2022-10-19T00:56:53.288406269Z ==> /var/log/apache2/access.log <==
nominatim  | 2022-10-19T00:56:53.288409445Z 192.168.1.20 - - [19/Oct/2022:00:56:52 +0000] "GET /reverse?format=json&lat=35.98294523653879&lon=-78.50658046743371 HTTP/1.1" 200 880 "-" "axios/0.27.2"
nominatim  | 2022-10-19T00:57:08.290070448Z 192.168.1.20 - - [19/Oct/2022:00:57:07 +0000] "GET /reverse?format=json&lat=35.901352019658034&lon=-78.94080116314315 HTTP/1.1" 200 946 "-" "axios/0.27.2"
nominatim  | 2022-10-19T00:57:18.291156103Z 192.168.1.20 - - [19/Oct/2022:00:57:17 +0000] "GET /reverse?format=json&lat=35.915396826171666&lon=-78.78175468366433 HTTP/1.1" 200 969 "-" "axios/0.27.2"
nominatim  | 2022-10-19T00:57:21.619272214Z Warming finished
nominatim  | 2022-10-19T00:57:21.619272770Z + echo 'Warming finished'
nominatim  | 2022-10-19T00:57:21.619298886Z + wait
nominatim  | 2022-10-19T00:57:23.291600250Z 192.168.1.20 - - [19/Oct/2022:00:57:22 +0000] "GET /reverse?format=json&lat=35.80435624553152&lon=-78.78334819623878 HTTP/1.1" 200 948 "-" "axios/0.27.2"
nominatim  | 2022-10-19T00:57:28.292029362Z 192.168.1.20 - - [19/Oct/2022:00:57:27 +0000] "GET /reverse?format=json&lat=35.366003742093696&lon=-80.72079203851347 HTTP/1.1" 200 941 "-" "axios/0.27.2"
nominatim  | 2022-10-19T00:57:33.292551004Z 192.168.1.20 - - [19/Oct/2022:00:57:32 +0000] "GET /reverse?format=json&lat=35.90673882571455&lon=-79.04918917487987 HTTP/1.1" 200 1008 "-" "axios/0.27.2"
nominatim  | 2022-10-19T00:57:33.292564509Z 192.168.1.20 - - [19/Oct/2022:00:57:32 +0000] "GET /reverse?format=json&lat=35.78415986163109&lon=-78.6429323051412 HTTP/1.1" 200 974 "-" "axios/0.27.2"
nominatim  | 2022-10-19T00:57:38.293144498Z 192.168.1.20 - - [19/Oct/2022:00:57:37 +0000] "GET /reverse?format=json&lat=35.91003076713884&lon=-78.77476062970287 HTTP/1.1" 200 1007 "-" "axios/0.27.2"
nominatim  | 2022-10-19T00:57:38.293153756Z 192.168.1.20 - - [19/Oct/2022:00:57:37 +0000] "GET /reverse?format=json&lat=35.78231674515843&lon=-78.64302095801602 HTTP/1.1" 200 1070 "-" "axios/0.27.2"
nominatim  | 2022-10-19T00:57:43.293751419Z 192.168.1.20 - - [19/Oct/2022:00:57:42 +0000] "GET /reverse?format=json&lat=35.70616437179311&lon=-79.8119455470735 HTTP/1.1" 200 967 "-" "axios/0.27.2"
nominatim  | 2022-10-19T00:57:43.293765737Z 192.168.1.20 - - [19/Oct/2022:00:57:42 +0000] "GET /reverse?format=json&lat=35.97701775007983&lon=-78.50950992709721 HTTP/1.1" 200 916 "-" "axios/0.27.2"
nominatim  | 2022-10-19T00:57:43.293768957Z 192.168.1.20 - - [19/Oct/2022:00:57:42 +0000] "GET /reverse?format=json&lat=35.903505026162776&lon=-79.04786487479042 HTTP/1.1" 200 1008 "-" "axios/0.27.2"
nominatim  | 2022-10-19T00:57:48.294440629Z 192.168.1.20 - - [19/Oct/2022:00:57:47 +0000] "GET /reverse?format=json&lat=35.81091091787584&lon=-78.78503020936218 HTTP/1.1" 200 891 "-" "axios/0.27.2"
nominatim  | 2022-10-19T00:57:58.295520860Z 192.168.1.20 - - [19/Oct/2022:00:57:57 +0000] "GET /reverse?format=json&lat=36.0661947716339&lon=-79.81439713729597 HTTP/1.1" 200 1000 "-" "axios/0.27.2"
nominatim  | 2022-10-19T00:57:58.295544155Z 192.168.1.20 - - [19/Oct/2022:00:57:57 +0000] "GET /reverse?format=json&lat=35.99248160004021&lon=-78.9202935933814 HTTP/1.1" 200 913 "-" "axios/0.27.2"
nominatim  | 2022-10-19T00:58:13.297315284Z 192.168.1.40 - - [19/Oct/2022:00:58:12 +0000] "-" 408 0 "-" "-"
nominatim  | 2022-10-19T00:58:13.297329239Z 192.168.1.40 - - [19/Oct/2022:00:58:12 +0000] "-" 408 0 "-" "-"
nominatim  | 2022-10-19T00:58:13.297331929Z 192.168.1.20 - - [19/Oct/2022:00:58:12 +0000] "GET /reverse?format=json&lat=35.930177245292604&lon=-79.02517236030855 HTTP/1.1" 200 877 "-" "axios/0.27.2"
nominatim  | 2022-10-19T00:58:13.297333899Z 
nominatim  | 2022-10-19T00:58:13.297335484Z ==> /var/log/apache2/error.log <==
nominatim  | 2022-10-19T00:58:13.297340016Z [Wed Oct 19 00:58:12.335382 2022] [reqtimeout:info] [pid 92] [client 192.168.1.40:56983] AH01382: Request header read timeout
nominatim  | 2022-10-19T00:58:13.297341693Z [Wed Oct 19 00:58:12.335407 2022] [reqtimeout:info] [pid 91] [client 192.168.1.40:56984] AH01382: Request header read timeout
nominatim  | 2022-10-19T00:58:18.297752376Z 
nominatim  | 2022-10-19T00:58:18.297764595Z ==> /var/log/apache2/access.log <==
nominatim  | 2022-10-19T00:58:18.297767524Z 192.168.1.20 - - [19/Oct/2022:00:58:17 +0000] "GET /reverse?format=json&lat=35.871205865208&lon=-78.62254006067882 HTTP/1.1" 200 922 "-" "axios/0.27.2"
nominatim  | 2022-10-19T00:58:23.298517796Z 192.168.1.20 - - [19/Oct/2022:00:58:22 +0000] "GET /reverse?format=json&lat=35.78218709737923&lon=-78.6646499125202 HTTP/1.1" 200 935 "-" "axios/0.27.2"
nominatim  | 2022-10-19T00:58:28.298855977Z 192.168.1.20 - - [19/Oct/2022:00:58:27 +0000] "GET /reverse?format=json&lat=35.993361051824884&lon=-78.89819007478071 HTTP/1.1" 200 1010 "-" "axios/0.27.2"
nominatim  | 2022-10-19T00:58:43.300622606Z 192.168.1.20 - - [19/Oct/2022:00:58:42 +0000] "GET /reverse?format=json&lat=35.89925756808916&lon=-78.7924661340899 HTTP/1.1" 200 966 "-" "axios/0.27.2"

results after update:

This XML file does not appear to have any style information associated with it. The document tree is shown below.
<reversegeocode timestamp="Wed, 19 Oct 22 00:28:15 +0000" attribution="Data © OpenStreetMap contributors, ODbL 1.0. http://www.openstreetmap.org/copyright" querystring="lat=35.910227&lon=-79.045599">
<result place_id="1404418" osm_type="relation" osm_id="2882828" ref="University of North Carolina at Chapel Hill" lat="35.90503535" lon="-79.04775326525107" boundingbox="35.8933498,35.9164642,-79.0923215,-79.0269224" place_rank="30" address_rank="30">University of North Carolina, Berryhill Drive, Rose Walk, Weatherhill, Carrboro, Orange County, North Carolina, 27510, United States</result>
<addressparts>
<amenity>University of North Carolina</amenity>
<road>Berryhill Drive</road>
<neighbourhood>Rose Walk</neighbourhood>
<hamlet>Weatherhill</hamlet>
<town>Carrboro</town>
<county>Orange County</county>
<state>North Carolina</state>
<ISO3166-2-lvl4>US-NC</ISO3166-2-lvl4>
<postcode>27510</postcode>
<country>United States</country>
<country_code>us</country_code>
</addressparts>
</reversegeocode>
matt-yml commented 1 year ago

This appears to be resolving correctly now with nominatim config updates. Will move forward with nominatim 4.1 -> 4.2 anyway.

Image

Image

matt-yml commented 1 year ago

upgrading to 4.2 a user agent to be set, and must be different from the default.

building fresh nominatim server from scratch.

https://github.com/mediagis/nominatim-docker/issues/420 https://developer.mozilla.org/en-US/docs/Web/HTTP/Headers/User-Agent

matt-yml commented 1 year ago

nominatim server is dumping all downloaded data to the console which causes pmlogger to crash.

for db build at least let's turn off logging

services:
  website:
    image: nginx
    logging:
      driver: none

so far so good. nominatim 4.2 here we come https://stackoverflow.com/questions/34590317/disable-logging-for-one-container-in-docker-compose

matt-yml commented 1 year ago

upgraded nominatim to 4.2. rebuilt the entire 21GB database with all input sources turned on.

problem with that one stop persists.

this is an issue with OSM's classification of the historical marker and not a technical one that can be addressed at this level. the gps coordinates are correct, as are directions from waze/google/apple.

at this point this mainly affects reposters that won't get the link from a screenshot.

closing and moving forward. hopefully OSM and/or nominatim will resolve this in the future.