search

codeforkansascity / meep-backend

MIT License
8 stars 11 forks source link

Create Projects csv from spreadsheets #36

Open galbwe opened 5 years ago

galbwe commented 5 years ago

Create a csv file from our existing spreadsheet data. Columns should be those from the Project model. Pandas will probably be your friend here. Feel free to message if you need access to the spreadsheets.

josiah14 commented 5 years ago

Is this related/a clone of the Data Collection issue from the frontend repo?

josiah14 commented 5 years ago

@galbwe I'd like to take a look at this one. I'd like to first establish a common location where all of the raw data for this project can be accessed. Depending on the retrieval patterns, I could see moving forward to creating a directory under this repo for data retrieval scripting to get the data into the raw storage location, and then follow that up with a data transformation pipeline that pulls from raw storage to get things into the format we want them in for analysis (probably in a PostgreSQL database schema or something).

hessianhobs commented 5 years ago

csv file uploaded into Google Drive