catalyst-cooperative / pudl

The Public Utility Data Liberation Project provides analysis-ready energy system data to climate advocates, researchers, policymakers, and journalists.
https://catalyst.coop/pudl
MIT License
456 stars 106 forks source link

Spot check past FERC Form 1 versions to match line numbers with FERC Accounts #41

Closed zaneselvans closed 7 years ago

zaneselvans commented 7 years ago

Periodically FERC updates their uniform chart of accounts for electric plant (e.g. they just recently added accounts for electricity storage devices, yay!). When this happens, the FERC Form 1 line numbers that correspond to a given FERC account may change. If that happens, all of our parsing of the f1_plant_in_srvce data will get messed up.

Somebody needs to go back and spot check some past years (between 2004 and 2015) to figure out if/when the lines-to-accounts mapping has changed in the past, and we'll need to generate a new mapping for each different set of lines/accounts. This could be done with old blank copies of Form 1 (maybe we can ask FERC?) or from the archived versions of the form that we got generated for PSCo. The page(s) we're interested in are FERC Form 1 pp 204-207.

For reference, the line-to-account mapping for 2015 is defined in a DataFrame named: pudl.constants.ferc_electric_plant_accounts

swinter2011 commented 7 years ago

I will reach out to FERC.

swinter2011 commented 7 years ago

OK - before reaching out to FERC I've founded 2011-2014 in CPI's Colorado files. Nikki's pages appear to be the Steam Generating Plant Statistics (pages 402-403).

swinter2011 commented 7 years ago

I've emailed FERC. We should probably also email CPI and ask them what they have.

swinter2011 commented 7 years ago

2011, 2012, 2013 and 2014 have the same line and account numbering as 2015.

swinter2011 commented 7 years ago

The form 1 line numbering and account numbers DO change -the REGIONAL TRANSMISSION AND MARKET OPERATION PLANT part of plant in service was added in 2006. If we do end up bringing in data from 2004 and 2005 we'll need to adjust our plant in service function to reflect that the line numbering differs for those two years.

swinter2011 commented 7 years ago

Likewise, there is an additional line in Form 1 page 219 - Accumulated Provision for Depreciation for Regional Transmission and Market Operation from 2006 onward so we'd need to keep that in mind for 2004 and 2005 as well.

swinter2011 commented 7 years ago

Pages 326-327 purchased power table appears unchanged!