Remove unused resources and provide a simple path to EMR behind MFA [WIP]

azavea / osmesa

OSMesa is an OpenStreetMap processing stack based on GeoTrellis and Apache Spark

Apache License 2.0

80 stars 26 forks source link

Remove unused resources and provide a simple path to EMR behind MFA [WIP] #55

Closed moradology closed 6 years ago

moradology commented 6 years ago

This PR attempts to remove all the cruft built up from iteration over technologies/strategies for working with OSM data and to motivate a simple path forward which uses EMR to create clusters and makefiles to submit steps.

As a bonus, the makefile works with MFA-requiring AWS accounts (tested against an assumeRole policy and aws sts on Geotrellis' aws account).

kamicut commented 6 years ago

Massive PR 👏 👍

moradology commented 6 years ago

Added the [WIP] tag to signify that this is a bit of a living document - a few commands (which i.e. kick off urchn tile creation) still live in the old Makefile within deployment - but much of the code that corresponded to prior iterations/technology stacks has been culled.