This PR supersedes #182 (histories were for some reason diverging); see that PR for details.
The changes here have been tested by (1) bulk ingesting from a planet history dump, (2) recovering from a bulk ingest checkpoint (--use-checkpoint was set), (3) running streaming updaters for both stats and metadata, (4) comparing against the VP1/GT2 line by comparing their respective changesets tables (identify all changesets whose counts records differ).
The results agreed for all but approx. 300 changesets out of more than 1.6 million. That is based on a streaming history that covered more than six months of activity (streaming for both cases started at the same point in November, 2020).
[x] Merge and release VP2 version containing the changes in geotrellis/vectorpipe#148
This PR supersedes #182 (histories were for some reason diverging); see that PR for details.
The changes here have been tested by (1) bulk ingesting from a planet history dump, (2) recovering from a bulk ingest checkpoint (
--use-checkpoint
was set), (3) running streaming updaters for both stats and metadata, (4) comparing against the VP1/GT2 line by comparing their respectivechangesets
tables (identify all changesets whosecounts
records differ).The results agreed for all but approx. 300 changesets out of more than 1.6 million. That is based on a streaming history that covered more than six months of activity (streaming for both cases started at the same point in November, 2020).
errors
tableCloses #163 Closes #182