Overv / openstreetmap-tile-server

Docker file for a minimal effort OpenStreetMap tile server
Apache License 2.0
1.2k stars 482 forks source link

My container logs #372

Open devopsnot opened 1 year ago

devopsnot commented 1 year ago

I keep getting these logs below in a way, which are generated non-stop, getting complicated when I need to be performing a log analysis

[2023-04-20 23:05:04] 1293 importing diff
[2023-04-20 23:05:04] 1293 expiring tiles
[2023-04-20 23:05:04] 1293 Done with import
Total for all tiles rendered
Meta tiles rendered: Rendered 0 tiles in 0.00 seconds (0.00 tiles/s)
Total tiles rendered: Rendered 0 tiles in 0.00 seconds (0.00 tiles/s)
Total tiles in input: 0
Total tiles expanded from input: 0
Total meta tiles deleted: 0
Total meta tiles touched: 0
Total tiles ignored (not on disk): 0
[2023-04-20 23:06:01] 1406 start import from seq-nr 92944, replag is 361s
[2023-04-20 23:06:01] 1406 downloading diff
tail: /var/log/tiles/osmosis.log: file truncated
Apr 20, 2023 11:06:01 PM org.openstreetmap.osmosis.core.Osmosis run
INFO: Osmosis Version 0.48.3
Apr 20, 2023 11:06:01 PM org.openstreetmap.osmosis.core.Osmosis run
INFO: Preparing pipeline.
Apr 20, 2023 11:06:01 PM org.openstreetmap.osmosis.core.Osmosis run
INFO: Launching pipeline execution.
Apr 20, 2023 11:06:01 PM org.openstreetmap.osmosis.core.Osmosis run
INFO: Pipeline executing, waiting for completion.
Apr 20, 2023 11:06:03 PM org.openstreetmap.osmosis.replication.v0_6.BaseReplicationDownloader runImpl
INFO: Reading current server state. [ReplicationState(timestamp=Thu Apr 20 23:00:00 GMT 2023, sequenceNumber=92944)]
Apr 20, 2023 11:06:04 PM org.openstreetmap.osmosis.core.Osmosis run
INFO: Pipeline complete.
Apr 20, 2023 11:06:04 PM org.openstreetmap.osmosis.core.Osmosis run
INFO: Total execution time: 2626 milliseconds.
[2023-04-20 23:06:04] 1406 filtering diff
/home/renderer/src/regional/trim_osc.py:211: FutureWarning: GzipFile was opened for writing, but this will change in future Python releases.  Specify the mode argument for opening it for writing.
  of = gzip.GzipFile(fileobj=of)
[2023-04-20 23:06:04] 1406 importing diff
[2023-04-20 23:06:04] 1406 expiring tiles
[2023-04-20 23:06:04] 1406 Done with import
Total for all tiles rendered
Meta tiles rendered: Rendered 0 tiles in 0.00 seconds (0.00 tiles/s)
Total tiles rendered: Rendered 0 tiles in 0.00 seconds (0.00 tiles/s)
Total tiles in input: 0
Total tiles expanded from input: 0
Total meta tiles deleted: 0
Total meta tiles touched: 0
Total tiles ignored (not on disk): 0

I changed the updates in my 'docker-compose.yaml' file to this one below, but it keeps getting updates every minute

    - REPLICATION_URL=https://planet.openstreetmap.org/replication/day/
    - MAX_INTERVAL_SECONDS=86400
devopsnot commented 1 year ago

Checking these logs I found that the tiles are not being updated

Always informing that the amount of update was equal to 0

Are the updates working?

IvanShift commented 1 year ago

I have the same issue:

[2023-04-18 07:28:01] 1954 start import from seq-nr , replag is
map_1  | [2023-04-18 07:29:01] 1977 start import from seq-nr , replag is
map_1  | [2023-04-18 07:30:01] 2000 start import from seq-nr , replag is
map_1  | [2023-04-18 07:31:01] 2023 start import from seq-nr , replag is
map_1  | [2023-04-18 07:32:01] 2046 start import from seq-nr , replag is
map_1  | [2023-04-18 07:33:01] 2069 start import from seq-nr , replag is
map_1  | [2023-04-18 07:34:01] 2092 start import from seq-nr , replag is
map_1  | [2023-04-18 07:35:01] 2215 start import from seq-nr , replag is
map_1  | [2023-04-18 07:36:01] 2276 start import from seq-nr , replag is
map_1  | [2023-04-18 07:37:01] 2383 start import from seq-nr , replag is
map_1  | [2023-04-18 07:38:01] 2406 start import from seq-nr , replag is
map_1  | Mapnik LOG> 2023-04-18 07:38:33: SVG PARSING ERROR:"SVG support error: <enable-background> attribute is not supported"
map_1  | Mapnik LOG> 2023-04-18 07:38:40: SVG PARSING ERROR:"SVG support error: <enable-background> attribute is not supported"
map_1  | Mapnik LOG> 2023-04-18 07:38:40: SVG PARSING ERROR:"SVG support error: <enable-background> attribute is not supported"
map_1  | Mapnik LOG> 2023-04-18 07:38:40: SVG PARSING ERROR:"SVG support error: <overflow> attribute is not supported"
map_1  | Mapnik LOG> 2023-04-18 07:38:40: SVG PARSING ERROR:"SVG support error: <enable-background> attribute is not supported"
map_1  | Mapnik LOG> 2023-04-18 07:38:40: SVG PARSING ERROR:"SVG support error: <enable-background> attribute is not supported"
map_1  | [2023-04-18 07:39:01] 2478 start import from seq-nr , replag is
map_1  | [2023-04-18 07:40:01] 2501 start import from seq-nr , replag is
map_1  | [2023-04-18 07:41:01] 2536 start import from seq-nr , replag is

No update information, replag and it start update every minute (never stops) with no result.

balchen commented 1 year ago

@IvanShift I had the same issue. Turned out the /data/.osmosis directory had not been migrated when I moved my data, and so the state required for the update job to run was missing. The result was exactly what you see here.

To resolve it, I connected to the container and ran the commands that are run initially when you set up updates during import:

REPLICATION_TIMESTAMP=osmium fileinfo -g header.option.osmosis_replication_timestamp /data/region.osm.pbf
sudo -E -u renderer openstreetmap-tiles-update-expire.sh $REPLICATION_TIMESTAMP

This restored the missing state in /data/.osmosis and allowed updates to resume. It didn't fix the entire issue, though. Not all changes that had happened were merged into my local db, so I ended up doing a full re-import anyway.

OptiMael commented 1 year ago

May be related to this case I just opened:

383

balchen commented 1 year ago

May be related to this case I just opened: #383

That's interesting. It seems it would completely void any config changes when running openstreetmap-tiles-update-expire.sh.

In my case, the required state was missing from disk, not from env. That's not to say your env issue didn't affect others in other ways.