In https://github.com/singularity-energy/open-grid-emissions/pull/353, we required that the subplant identification code load raw EIA-860 data from the latest validated year (2022). However, if running the pipeline for the first time for any year other than the latest validated year, this would lead to an error, since that file is not downloaded. This PR adds code to download the EIA-860 file for the latest validated year.
Fixed CAR-3907
What the code is doing
See data_pipeline.py
Testing
Ran the download part of the data pipeline for 2019.
Where to look
See data_pipeline.py
Usage Example/Visuals
Review estimate
1 min
Future work
What issues were identified that are not being addressed in this PR but should be addressed in future work?
Checklist
[ ] Update the documentation to reflect changes made in this PR
[ ] Format all updated python files using black
[ ] Clear outputs from all notebooks modified
[ ] Add docstrings and type hints to any new functions created
Purpose
In https://github.com/singularity-energy/open-grid-emissions/pull/353, we required that the subplant identification code load raw EIA-860 data from the latest validated year (2022). However, if running the pipeline for the first time for any year other than the latest validated year, this would lead to an error, since that file is not downloaded. This PR adds code to download the EIA-860 file for the latest validated year.
Fixed CAR-3907
What the code is doing
See data_pipeline.py
Testing
Ran the download part of the data pipeline for 2019.
Where to look
See data_pipeline.py
Usage Example/Visuals
Review estimate
1 min
Future work
What issues were identified that are not being addressed in this PR but should be addressed in future work?
Checklist
black