openeventdata / phoenix_pipeline

Turning news into events since 2014.
MIT License
50 stars 33 forks source link

Extensive pipeline changes #9

Closed philip-schrodt closed 10 years ago

philip-schrodt commented 10 years ago

Extensive changes to handle uploads, obtain file names from PHOX_config.ini, and standardize error handling. All parts except the initial call to scraper_connection.main() have been tested and upload correctly to the openeventdata.org site. PHOX_config.ini does not contain log-in information but does have all of the operational file names. There are a few remaining issues that have been logged.