azavea / osmesa

OSMesa is an OpenStreetMap processing stack based on GeoTrellis and Apache Spark
Apache License 2.0
80 stars 26 forks source link

Add gzip compression on write to S3 #59

Closed moradology closed 6 years ago

moradology commented 6 years ago

Tippeanoe's default behavior is to pre-gzip the pbf files as it does a directory-dump of vector tiles. This PR adds similar functionality and sets the appropriate headers on S3.

moradology commented 6 years ago

It absolutely should. I'd like to hold off on merging this until after the demo, but I'll be sure to get those additional changes in prior to the merge

mojodna commented 6 years ago

Actually, given the need to include a Content-Type header, it's probably less shocking to get uncompressed tiles out of the zip (and to be able to gzip them if desired).