search

hackforwesternmass / frcog-private-wells

2 stars 0 forks source link

duplicated effort in data/csv processing between work done for fusion tables and work done for dbs #10

Open hjw opened 11 years ago

hjw commented 11 years ago

David did some work to turn the spreadsheet data provided by DEP into csv files and Russ has also done work with that as well as work to push the csv data into the db.

We've a data dir and a database dir and it's not terribly clear what lives where. It would be good to clean this up.

hjw commented 11 years ago

There's a potentially useufull addon to django https://github.com/edcrewe/django-csvimport

This would add a csv import option to the admin page, potentially helping Glen as he added more and more files from the DEP.

I've started playing with it, but my understanding of where to put requirements when dealing with python/django projects is nil. So.... where would one indicate that this needs to be installed in the environment? Once installed with pip I just add it to the project's settings file.

dgarant commented 11 years ago

Heroku wants to see all Python package dependencies in requirements.txt. If you put the name of the package in there (version specification optional), you should be all set.

hjw commented 11 years ago

Thanks. I'll do that on my next commit. For the moment, I'm closing my computer and moving on with my day.

-Hawley On Jun 3, 2013, at 9:57 AM, dgarant notifications@github.com wrote:

Heroku wants to see all Python package dependencies in requirements.txt. If you put the name of the package in there (version specification optional), you should be all set.

— Reply to this email directly or view it on GitHub.

hjw commented 11 years ago

I've pulled the data and database dirs in from master, re-organized them, added some README files which hopefully make sense.

I also added the csv import function to the admin page and made sure that it works for the munis and well_types files.
TODO-> dump heroku well data to a csv and makes sure it works with the admin import module. Once we can easily import/export csv well data from/to the django site we can create the glue to push/pull from the fusion tables.