azavea / osmesa

OSMesa is an OpenStreetMap processing stack based on GeoTrellis and Apache Spark
Apache License 2.0
79 stars 26 forks source link

Total edits appears not to update correctly for streaming updates #165

Closed jpolchlo closed 4 years ago

jpolchlo commented 4 years ago

It has become apparent that the total_edits field of the changesets table is not updating in streaming jobs. Need to investigate why this is occurring and create a fix.

Closes azavea/osmesa-stat-server#25

echeipesh commented 4 years ago

rebuilding the augdiff stream resolved the issue but the root cause is still unclear.

CloudNiner commented 4 years ago

Reopening this to better resolve after a discussion with @jpolchlo. There are significant discrepancies that weren't fixed by rebuilding the aug diff stream. I'm going to investigate a bit more and create a better fix for the counts, since they're significantly different on staging and production.

CloudNiner commented 4 years ago

Closed by #184