search

singularity-energy / open-grid-emissions

Tools for producing high-quality hourly generation and emissions data for U.S. electric grids
MIT License
67 stars 4 forks source link

Fix EIA-923 Allocation Error #314

Open grgmiller opened 7 months ago

grgmiller commented 7 months ago

When running the 2021 data pipeline with our new data validation checks, the following warning is raised:

2023-06-09 17:39:24,002 [WARNING] oge.validation:78 Allocated EIA-923 doesn't match input data for plants:
2023-06-09 17:39:24,002 [WARNING] oge.validation:79 Percentage Difference:
2023-06-09 17:39:24,004 [WARNING] oge.validation:80 
              net_generation_mwh  fuel_consumed_mmbtu  fuel_consumed_for_electricity_mmbtu
plant_id_eia                                                                              
1206                   -0.001076            -0.002514                            -0.002514
1316                    0.023964             0.000000                             0.000000
52148                  -0.000151            -0.000023                            -0.000111
54224                  -0.000207            -0.000113                            -0.000161
54967                  -1.000000            -1.000000                            -1.000000
58256                   0.411966             0.000000                             0.000000
59260                  -0.475486            -0.475496                            -0.475496
59825                  -1.000000            -1.000000                            -1.000000
63098                  -1.000000            -1.000000                            -1.000000
2023-06-09 17:39:24,004 [WARNING] oge.validation:81 EIA-923 Input Totals:
2023-06-09 17:39:24,006 [WARNING] oge.validation:82 
              net_generation_mwh  fuel_consumed_mmbtu  fuel_consumed_for_electricity_mmbtu
plant_id_eia                                                                              
1206                   56313.000             493763.0                             493763.0
1316                    2003.000              32704.0                              32704.0
52148                  10585.000             779330.0                              62793.0
54224                  72122.771            1329124.0                             409850.0
54967                      1.960                 24.0                                 24.0
58256                    585.000               7304.0                               7304.0
59260                   1760.000              28873.0                              28873.0
59825                   9539.000              84354.0                              84354.0
63098                      1.000                  6.0                                  6.0
2023-06-09 17:39:24,006 [WARNING] oge.validation:85 Allocated Totals:
2023-06-09 17:39:24,008 [WARNING] oge.validation:86 
              net_generation_mwh  fuel_consumed_mmbtu  fuel_consumed_for_electricity_mmbtu
plant_id_eia                                                                              
1206                56252.431817         4.925215e+05                        492521.524247
1316                 2051.000000         3.270400e+04                         32704.000000
52148               10583.399000         7.793120e+05                         62786.000000
54224               72107.811000         1.328974e+06                        409784.000000
54967                   0.000000         0.000000e+00                             0.000000
58256                 826.000000         7.304000e+03                          7304.000000
59260                 923.144000         1.514400e+04                         15144.000000
59825                   0.000000         0.000000e+00                             0.000000
63098                   0.000000         0.000000e+00                             0.000000

Some of these might be due to rounding errors, but there are several plants where a large portion of fuel generation (or all fuel/generation) is disappearing somewhere in the allocation process.

It may be worth updating our dependencies first to see if/how this issue changes. It is possible this may be a bug somewhere in the pudl code.