Optional installed apps

fgregg commented 5 years ago

this PR

adjusts the crontab for the chicago scrapers so that the DATABASE_URL environmental variable will reference the database for the staging site for Chicago Councilmatic.
adjusts pupa_settings to optionally add some django "INSTALLED_APPS" if the DATABASE_URL has 'chicago' in it. This is necessary because the django-councilmatic app needs to be an installed app in order for the creationg of opencivicdata objects to trigger `councilmatic_core1 objects. This won't affect non chicago scrapes.
add django-councilmatic as a dependency in requirements.txt

fgregg commented 5 years ago

@hancush I have responded to your comments and requested changes

fgregg commented 5 years ago

hi hannah, made a few adjustments here

For the high frequency chicago scrapes, scrape directly into the production databases. For the nightly scrape, start with a just scraping the material to the file system then do three different imports into the production, staging, and OCD API database

I also adjusted the paths of the requirements.txt for github depdendencies. I think the old pattern is deprecated.

I'd appreciate it if you could get to this this morning?

datamade / scrapers-us-municipal

Optional installed apps #39