CodeForPittsburgh / food-access-map-data

Data for the food access map
MIT License
8 stars 18 forks source link

just_harvest.csv missing Schema Columns #151

Closed maxachis closed 3 years ago

maxachis commented 3 years ago

While working on my data validation script, the script picked up that just_harvest.csv does not have some columns which are specified in the Schema. Specifically, missing "WIC|FMNP | fresh_produce | food_bucks | free_distribution". My data validation script is assuming that if a file located in the "Cleaned_data_files" directory is missing columns listed in the schema, that file is in an improper format and the Github Action will stop.

If that's an assumption we want to make, then just_harvest.csv and/or its prep script needs to be amended to include those columns. If we don't want to make that assumption, then we'll just need to talk about what the requirements are, specifically.

hellonewman commented 3 years ago

@maxachis I updated the prep script for just harvest to add in these fields. If you try to re-run it should be fixed

maxachis commented 3 years ago

Yep, works as intended. Closing this issue now.