azavea / osmesa

OSMesa is an OpenStreetMap processing stack based on GeoTrellis and Apache Spark
Apache License 2.0
79 stars 26 forks source link

Upgrade dependencies to VectorPipe2 and GT3 #218

Closed jpolchlo closed 2 years ago

jpolchlo commented 3 years ago

This PR supersedes #182 (histories were for some reason diverging); see that PR for details.

The changes here have been tested by (1) bulk ingesting from a planet history dump, (2) recovering from a bulk ingest checkpoint (--use-checkpoint was set), (3) running streaming updaters for both stats and metadata, (4) comparing against the VP1/GT2 line by comparing their respective changesets tables (identify all changesets whose counts records differ).

The results agreed for all but approx. 300 changesets out of more than 1.6 million. That is based on a streaming history that covered more than six months of activity (streaming for both cases started at the same point in November, 2020).

Closes #163 Closes #182

CloudNiner commented 3 years ago

🎉

CloudNiner commented 2 years ago

🔥