search

openeventdata / phoenix_pipeline

Turning news into events since 2014.
MIT License
50 stars 33 forks source link

What intermediate files do we want to leave in the pipeline working directory? #14

Closed philip-schrodt closed 10 years ago

philip-schrodt commented 10 years ago

I've currently left all of the intermediate files in the working directory, including those eventually uploaded to the remote server (openeventdata.org). We probably want to get rid of these, particularly once they are on a mirror.

johnb30 commented 10 years ago

We should also explore either 1) keeping things in a different directory or 2) passing things around as a dictionary or JSON within the application. Would probably make things flow better and give less chance for subtle bugs to be introduced.

johnb30 commented 10 years ago

Addressed partially by #38.