document how to build a standard ingest pipeline - Githubissues

diagonalworks / diagonal-b6

b6: Diagonal's geospatial analysis engine.

Apache License 2.0

24 stars 3 forks source link

document how to build a standard ingest pipeline #282

Open gacafe opened 4 months ago

gacafe commented 4 months ago

i want to understand the general flow of an ingest pipeline for [1] points and [2] polygons - so that it can be modified.

[ ] how does it flow
[ ] what is hard coded
[ ] how do you build the binary
[ ] how to add a new one
[ ] how to run it using k8
[ ] where do you grab the data for each ingestion (e.g. OSM / GTFS) ?
[ ] explain versioning of compact data