search

geotrellis / vectorpipe

Convert Vector data to VectorTiles with GeoTrellis.
https://geotrellis.github.io/vectorpipe/
Other
74 stars 20 forks source link

Return Dataset[BinaryTile] so generated MVTs can be stored in a single output #100

Closed mojodna closed 3 years ago

mojodna commented 5 years ago

Overview

This is in addition to (optionally) writing individual MVTs out. This will save on object management and time taken to PUT individual tiles.

The single output contained generated MVTs can be subsequently processed to extract specific tiles or to write to an alternate data sink (e.g. MBTiles (#51)).

Checklist

jpolchlo commented 5 years ago

I approve of this concept. Would be good for benchmarking purposes as well to cut out the costly write operation. Would love to see if we can come up with a way to generate an MBTiles file out of one of these Dataset[BinaryTile] guys.

jpolchlo commented 5 years ago

Oh, but, we should hold off on deploying this until after 1.0.0

jpolchlo commented 3 years ago

This (I think) has been obviated by #140. Reopen if that's not true.

mojodna commented 3 years ago

👋 Not quite (as far as I can imagine). I can imagine using finalize to output a single file(set) per zoom, but returning Unit from the end of the pipeline makes it difficult (impossible?) to accumulate (ideally lazily and optionally) all of the tiles for all of the zooms into a single data frame (and potentially re-group tiles from multiple zooms together).