azavea / osmesa

OSMesa is an OpenStreetMap processing stack based on GeoTrellis and Apache Spark
Apache License 2.0
79 stars 26 forks source link

Integrate postgres Notification list with AugmentedDiff source #162

Closed CloudNiner closed 4 years ago

CloudNiner commented 4 years ago

The postgres table containing notifications was simplified such that we now just have a Notification table that directly contains each geometry and its name. This is because the MVP prototype specifically describes a notification as relating one to one to an AOI geom. No sense building something more complicated to prove a concept. We can always re-normalize later. Given that we want to just group on notification id.

The data types were refactored a bit in order to match names to the types a bit better.

Deletes the remaining references/usages to the stubs that provided static geojson data.

CloudNiner commented 4 years ago

I still haven't been able to get this to successfully run in develop, even passing AWS_PROFILE=<correct profile> to sbt or setting it in my shell environment, I always get auth errors against the bucket it tries to pull augmented diffs from. Could you verify that this is an issue for you as well, or are you able to get this to connect to the augmented diff bucket?

jpolchlo commented 4 years ago

Would be great to have a way to specify the database URI as a command line option that falls back on environment variables. This is easier to specify for manual debugging purposes.

CloudNiner commented 4 years ago

@jpolchlo this could use another look. With the new changes, I was able to get this to run to an exit 0 return code and display a match for my test area:

Screen Shot 2019-10-31 at 4 52 46 PM

CloudNiner commented 4 years ago

Managed to compile and run to completion for the daily interval.

WHOOP. 🎉