singularity-energy / open-grid-emissions

Tools for producing high-quality hourly generation and emissions data for U.S. electric grids
MIT License
67 stars 4 forks source link

Fix pipeline when running with --small argument #320

Open rouille opened 6 months ago

rouille commented 6 months ago

In section 12 (Clean and Reconcile EIA-930 data), the file used to build residual profiles is data/eia930/chalendar/EBA_elec.csv if running small. This file has a different header than the one used to clean the whole year causing the load_chalendar_for_pipeline function located in the eia930 module to raise an error. The issue comes from the filtering of the data frame performed here that returns an empty data frame

grgmiller commented 6 months ago

Specifically, the old column format included .NG.ALL-H, but it looks like the new format is E_BA_NG