azavea / osmesa

OSMesa is an OpenStreetMap processing stack based on GeoTrellis and Apache Spark
Apache License 2.0
80 stars 26 forks source link

Fix/caching partitions; spatial key printing #61

Closed moradology closed 6 years ago

moradology commented 6 years ago

This PR addresses two issues. Spatial keys are now appended so that multiple jobs can safely be run (useful for bbox vector tile construction). The PR also gives a sensible 500 partitions to the job of caching out work - this should significantly improve performance of reads and writes.