felt / tippecanoe

Build vector tilesets from large collections of GeoJSON features.
BSD 2-Clause "Simplified" License
917 stars 81 forks source link

--output-to-tar #267

Open Krizz opened 2 days ago

Krizz commented 2 days ago

Is this something that could be merged? output-to-tar functionality seems to work well, so I wonder is this a feature that got lost in the process?

https://github.com/mapbox/tippecanoe/pull/789

e-n-f commented 2 days ago

I don't remember why I was working on this in the first place. The problem with merging it now is that creating the tileset is no longer append-only, since as-needed dropping now assumes that each zoom level is going to work on the first try, and erases the attempt from the mbtiles if it was not. So it would at least need the ability to rewind to the start of the zoom rather than being able to write tar format to stdout.

Krizz commented 1 day ago

It was a useful feature that allowed me to stream data directly into other databases (Clickhouse), without having to parse the MBTiles file afterward. This approach enabled to join the tile features with other data tables without the need to recreate the MBTiles file each time frequently changing data gets updated.

Not having the feature does not exactly break the workflow - just makes the process take a bit longer. Not a big issue, especially if the current code does not support this feature anymore.