Open dt-woods opened 11 months ago
Well this seems problematic. Based on this FERC webpage, it seems like FERC has largely given up on trying to track this data themselves.
Regarding your questions:
Does the electricity baseline need to support mapping to FERC/NERC regions or are EIA regions and their balancing authorities good enough?
I don't have an immediate negative reaction to using the EIA regions (Southeast, Midwest, Northwest, Southwest, California, Carolinas, Texas, Florida, New England, New York, Mid-Atlantic, Central, Tennessee). I might need to check in with Greg Cooney to see if there was a real strong desire for getting FERC specifically or if the desire was more around having some sort of level of aggregation between BAA and US.
After looking all this over, the mapping of EIA region to FERC region might have just been a visual assessment rather than an explicit crosswalk. To that end, it might be reasonable to keep using the existing EIA region to FERC region mapping that exists in that file and simply using the new version of EIA930.
I would prefer to maintain the ability to do FERC rather than having to go in an make changes to all instances of FERC to EIA or something.
Can do. Thanks, Matt.
BTW, from a cursory look at EIA 930, there may be some-to-a-few more BAs added the mix since 2016. Shall we employ the same "based on visual inspection" mapping and just update the existing workbook?
Well the mapping I believe is from EIA region to FERC region, so we shouldn't need to evaluate each BAA. The BAAs are already mapped to EIA regions in the 930 data. Just need to reuse the lookup table I think.
Good point! (until they introduce new regions)
To replace 'BA_Codes_930.xlsx' (reference by read_ba_codes in utils.py) and its supplement 'BA code match.csv' (used in utils.py and eia860_facilities.py):
See Microsoft Excel workbook: https://www.eia.gov/electricity/930-content/EIA930_Reference_Tables.xlsx
Columns from the 'BAs' worksheet include:
Apply the following EIA region to FERC region mapping:
EIA Region | FERC Region |
---|---|
California | CAISO |
Carolinas | Southeast (SE) |
Central | SPP |
Electric Reliability Council of Texas, Inc. | ERCOT |
Florida | Southeast (SE) |
Mid-Atlantic | PJM |
Midwest | MISO |
New England ISO | ISO-NE |
New York Independent System Operator | NYISO |
Northwest | Northwest (NW) |
Southeast | Southeast (SE) |
Southwest | Southwest (SW) |
Tennessee Valley Authority | Southeast (SE) |
This mapping is based on the now defunct 'Electric Power Markets' map provided by www.ferc.gov (displayed below for posterity):
Note that additional information is also available, including active status (Yes/No), activation/retirement date. For mapping purposes, all BAs (active and inactive) should probably be included.
Note to self, the EI923_Schedules_2_3_4_5_M_12_2022_Final.xlsx, page 7 'File Layout' has a section called Balancing Authority Code, which includes the BA Code and BA Name.
In the provided data file, BA_Codes_930.xlsx, the EIA 930 data table is used to match balancing authority names/codes to EIA regions (and their codes). In a separate worksheet (in the same workbook), FERC regions are identified. The source link provided is https://www.ferc.gov/market-oversight/mkt-electric/overview.asp, which throws a "Not Found" error when accessed.
The FERC website includes a map that provides a generalized look of the RTOs and ISOs, notably without data file(s) to support it. There are 10 FERC regions identified:
In search of FERC regions, I found the "NERC Regions" and "Independent System Operators" data files on the Homeland Infrastructure Foundation-Level Data (HIFLD) website. The ISO data file matches seven of the 10 above.
Not sure how to identify the "Northwest," "Southeast," and "Southwest" regions that aren't identified in the HIFLD data.
From DOE white paper, "How it Works: The Role of a Balancing Authority," notes that there are three ISOs and four RTOs that operate in the US:
The issue is that large swaths of the US are not covered by one of these seven (i.e., the northwest, southwest and southeast).
In the blog, "Comparing FERC and EIA electricity demand data" by Tyler H. Ruggles, a CSV for mapping FERC respondents (as found in FERC Form 714) to EIA balancing authorities is provided, but without explanation of methods (see CSV), but not sure how to condense the 200 FERC respondents down to the ten regions.
The main questions are: