CityOfLosAngeles / dot-planner

Planning software and database for Active Transportation Projects
Apache License 2.0
9 stars 7 forks source link

Batch Upload New Geo-Spatial Projects #159

Open JacquiSwartz opened 7 years ago

JacquiSwartz commented 7 years ago

I have a new set of geocoded projects that need to be uploaded to the database. What is the most efficient way to do that?

patwater commented 7 years ago

You all should check out Airbnb's airflow automation and scheduling tool set -- super useful for automating data ingestion and what we use for ETLing and deploying Analytics as part of our ELTA pipeline for the CaDC coalition of water utilities: https://medium.com/airbnb-engineering/airflow-a-workflow-management-platform-46318b977fd8

:)