dcl-covid-19 / mega-map

Bay Area resource map
5 stars 8 forks source link

Automate the NKH CSV export. #57

Open charliehoffs opened 3 years ago

charliehoffs commented 3 years ago

Motivation/Context: BAC is the most accurate, up-to-date map of school meal sites in the Bay Area! Recognizing the quality of our data, the national organization No Kid Hungry (NKH) has been sourcing the data for the Bay Area regions of their Free Meal Find MAp and Texting Hotline (https://www.nokidhungry.org/find-free-meals) for the past year, which is linked on school districts', local governments', and food assistance websites across the region.

9 volunteers manually update our data every two weeks by checking school district websites and social media pages. 2 of our 9 volunteers - our School Meals Team Leads - conduct monthly data quality audits on the entire >1000 school database.

Currently, to get this updated data to NKH, @mudkins downloads a CSV from Airtable, does the following procedure transforming the CSV's data structure to the NKH template (https://github.com/dcl-covid-19/mega-map/tree/master/Tutorial:%20Airtable%20to%20NKH), then we download the emerging Google Sheet and email it to NKH.

To further automate this process and allow NKH to download new data whenever they please from our updated database, and remove the necessity of our manually sending it, we want to create a "View" in Airtable, with the data pre-transformed to NKH's structure, from which they can download a CSV anytime.

Achieving this goal will allow us to scale this process to other partners, with whom we hope to build similar data-sending relationships, so local organizations can easily take in (per their own data structure) BAC's high-quality updated data.

Estimate of time: TBD

Definition of Done:

Suggested next steps:

mudkins commented 3 years ago

i'll do this!

charliehoffs commented 3 years ago

AWESOME! Thank you @mudkins !! If helpful, I can imagine that other team members might have some clues about how we could make this work too, so hopefully folks can be helpful on the Monday night call and in the #bac-data-engineering channel, as needed!!