search

California-Data-Collaborative / cadc_reservoir_explorer

An agile approach to visualizing California's reservoir levels in real-time.
MIT License
5 stars 0 forks source link

Scheduling regular updates #6

Closed patwater closed 6 years ago

patwater commented 6 years ago

Here's a getting started guide with Apache Airflow: https://medium.com/a-r-g-o/installing-apache-airflow-on-ubuntu-aws-6ebac15db211

Here's the old parsekit scripts for reference which detail the specific links and fields from the state data: https://github.com/California-Data-Collaborative/cadc_reservoir_explorer/tree/master/ParseKit%20Scripts

patwater commented 6 years ago

@mike-amodeo good chatting and pulling in the historical data and deploying locally sounds like a good start. This provides a nice technical overview of some of the technical requirements for regular data updates: https://github.com/California-Data-Collaborative/cadc_reservoir_explorer/projects

CC @dmarulli

patwater commented 6 years ago

@mike-amodeo @dmarulli can we close this for the reservoir data updates?

dmarulli commented 6 years ago

yep. closing now.