WPRDC / wprdc-etl

MIT License
8 stars 3 forks source link

refactor pipeline code, add pipeline tests #11

Closed bsmithgall closed 8 years ago

bsmithgall commented 8 years ago

Configuration should be on a pipeline level and accessible from the pipeline's components, so I moved the configuration to the Pipeline instantiation from the Loader instantiation. I also moved a few things around and created some more explicit Exception handling in certain places.

Additionally, I added unit test coverage to the Pipeline class and the various pipeline components.