catalyst-cooperative / pudl

The Public Utility Data Liberation Project provides analysis-ready energy system data to climate advocates, researchers, policymakers, and journalists.
https://catalyst.coop/pudl
MIT License
456 stars 106 forks source link

2019 CEMS data? #552

Closed skoeb closed 4 years ago

skoeb commented 4 years ago

Hi there, excellent project.

2019 CEMS data appears to be available here: ftp://newftp.epa.gov/DMDnLoad/emissions/hourly/monthly/2019/

any reason this isn't incorporated into PUDL?

zaneselvans commented 4 years ago

It's because the final EIA 860 and EIA 923 data releases, which we process alongside CEMS, only come out in Sept/Oct of the following year, and we haven't tackled integrating year-to-date data from any of these sources yet, because they have a slightly different format, and not all of the entities are required to report monthly.

skoeb commented 4 years ago

Gotcha, thanks!

zaneselvans commented 4 years ago

But not to worry, as soon as the 2019 data is out for the eia sources we will pull in all the new CEMS data too. And we do hope to get year-to-date releases integrated at some point. It just hasn't been the highest priority yet.