search

catalyst-cooperative / pudl

The Public Utility Data Liberation Project provides analysis-ready energy system data to climate advocates, researchers, policymakers, and journalists.
https://catalyst.coop/pudl
MIT License
471 stars 108 forks source link

Enable ingest of EIA 860 w/out 923 #329

Closed cmgosnell closed 5 years ago

cmgosnell commented 5 years ago

We might want to enable a user to pull EIA 860 alone, or with just CEMS for instance. I'm not totally sure why 860-only ingest fails right now. I believe the only thing in the way of this right now is a tiny issue with the eia harvesting process. The prime_mover_code for boilers comes from 923 and not 860, and the harvesting process fails on this.

It could have to do with the fact that the sequence of how values are extracted from the original tables matters. You must take the location info for the plant before extracting the location of the utility because the process is predicated on finding the entity id's and most plant records also have utility ids and we don't want to wrongfully assign a plant location to a utility.

cmgosnell commented 5 years ago

Turns out we need a few of the 923 tables for the boiler generator associations, so I kept a few of the tables as the only tables that are used when only 860 is being used.