search

OpenHistoricalMap / issues

File your issues here, regardless of repo until we get all our repos squared away; we don't want to miss anything.
Creative Commons Zero v1.0 Universal
19 stars 1 forks source link

Vtiles stop updating and are not able to restart after failing #843

Closed Rub21 closed 1 week ago

Rub21 commented 4 months ago

Bug description

vtiles pipeline takes time to update changeset. sometimes it takes hours whit-out updates.

Repro Steps

  1. Upload large changeset with numerous objects .

cc. @jeffreyameyer

danrademacher commented 4 months ago

This is resolved in this PR https://github.com/OpenHistoricalMap/ohm-deploy/pull/341

jeffreyameyer commented 4 months ago

Seems this is still an issue. See: https://www.openhistoricalmap.org/changeset/128911

Rub21 commented 4 months ago

I was figuring out the issue. The problem is in the file 848.osc.gz (https://s3.amazonaws.com/planet.openhistoricalmap.org/replication/minute/001/480/848.osc.gz). The file is corrupted, causing imposm to get stuck there. The file appears to be quite large compared to other replication files.

Corrupted File Screenshot

I have not seen this issue before, but it seems we need to create a logging mechanism for such errors.

I fixed it manually and the tiler is updating the editions.

Rub21 commented 1 week ago

This issue has been fixed with the new workflow for the minutes replication files. https://github.com/OpenHistoricalMap/ohm-deploy/pull/382