search

IsraelHikingMap / VectorMap

Vector Maps for the Israel Hiking and Biking Maps
Other
9 stars 6 forks source link

Reliability of incremental update #124

Closed zstadler closed 3 years ago

zstadler commented 3 years ago

@Tsurha wrote by mail:

> לפני כמה שעות מחקתי את השביל ש-Amit Linenberg דיווח בפייסבוק שנחרש, ליד תעוז. > ניקיתי קאש והיסטוריה והוא עוד מופיע. ראה כאן: https://israelhiking.osm.org.il/map/17.75/31.8058/34.9727

Using make start-maputnik with postserve shows that the PostGIS DB was updated.

image

Using make start-tileserver-legend shows that this tile was not updated in data/tiles.mbtiles.

image

Analysis details

The update was done in changeset 111334909

It appears in openstreetmap.fr minutely update 4718745

The minutely update was processed successfully by the rebuild process and the mbtiles file size was increased: ``` Fri 17 Sep 2021 15:11:49 IDT INFO: Using replication server at http://download.openstreetmap.fr/replication/asia/israel_and_palestine/minute/ DEBUG: Using given sequence ID 4718740 DEBUG: Starting download at ID 4718741 (max 100 MB) DEBUG: Downloaded change 4718741. (102400 kB available in download buffer) DEBUG: Downloaded change 4718742. (102389 kB available in download buffer) DEBUG: Downloaded change 4718743. (102389 kB available in download buffer) DEBUG: Downloaded change 4718744. (102389 kB available in download buffer) DEBUG: Downloaded change 4718745. (102389 kB available in download buffer) Starting postgres docker compose target using default image (no recreate if exists) Starting maptiles_postgres_1 ... done [Sep 17 12:11:57] [WARN] [diff] cannot find state file /import/changes.state.txt [Sep 17 12:11:58] [INFO] [diff] Parsing changes, updating cache and removing elements took: 993.331673ms [Sep 17 12:11:58] [INFO] [ 0s] C: 0/s (123) N: 0/s (0) W: 0/s (15) R: 0/s (0) [Sep 17 12:11:59] [INFO] [PostGIS] Updating generalized tables took: 1.456919ms [Sep 17 12:12:02] [INFO] [diff] Writing added/modified elements took: 3.519197057s [Sep 17 12:12:02] [INFO] [ 3s] C: 0/s (0) N: 0/s (0) W: 0/s (17) R: 0/s (0) [Sep 17 12:12:02] [INFO] [diff] Processing /import/changes.osc.gz took: 4.824049798s Filtering deprecation warnings from the Mapnik's output. [27.553s] 100.0000% 19/ 19 @ 1/s | ✓ 19 □ 0 | 0s left -rw-r--r-- 1 osm osm 136183808 Sep 17 15:12 data/tiles.mbtiles tiledata/IHM.mbtiles size change: 372736 bytes ```

The tile URL is https://israelhiking.osm.org.il/vector/data/IHM/14/9783/6663.pbf

zstadler commented 3 years ago

The tiles file was locked for writing. As a result, the minutely and daily updates had no effect. A cleanup action was added to the production process in order to reduce the likelihood of such an event in the future.