jspeis
commented
4 years ago @innerstage welcome aboard Data USA ETL! For a first step before we meet tomorrow:
- [x] check out the repo bamboo-ipeds-pipeline
- [x] Begin reviewing the code in the pipeline contained in
sfa/aid_pipeline.py
Your first task will be to port this pipeline from the old style ComplexPipelineExecutor to an EasyPipeline (see admissions/pipeline.py for an example of how the new style pipeline ought to look like).
On Thursday we will review any questions regarding porting this pipeline, but feel free to ask questions in the meantime as well.
This first pipeline should be easy to update but note that other pipelines may have breaking changes that may require removing or altering available columns.
Again feel free to ask away and welcome aboard!
Onboarding @innerstage to IPEDS data