-
I followed the installation instructions on the readme file (https://github.com/PowerGenome/PowerGenome/blob/master/README.md) in order to install powergenome: using Mambaforge, downloading the PUDL d…
-
Ran into some permissions issues trying to test a new source of data (FERC EQR) in the Zenodo sandbox.
`pudl_archiver --datasets ferceqr --dry-run` requires the production token at present, returni…
-
Dagster introduces a lot of new concepts and code to PUDL. Make sure we continue the tradition of super rad documentation.
- [x] Release notes
- [x] Overview of dagster concepts: Resources, ops, j…
-
Many utilities identified in FERC, EIA, and EPA data are subsidiaries owned by some larger utility holding company. Understanding these ownership relationships can be helpful in understanding the econ…
-
In many cases, nuclear fuel "quantity" is actually reported to FERC directly in heat content (millions of BTUs or BTUs), but the "average mmbtu per unit" field in fuel_ferc1 is getting set to zero, wh…
-
We developed some tools for unpacking FERC Form 1 tables that are organized by row number (where each row should really be a column in a database table) for some client work, and this allows us to mak…
-
After the fuel and fuel_unit strings are cleaned up in the f1_fuel import, any record which contains any NA values is dropped, before the DataFrame is pulled into the PUDL DB. In some cases, this mean…
-
We have a real scraper for FERC Form 2, now we need a way to convert that into an archive on Zenodo.
This one is a little bit complicated, since there are now 3 different data formats, they overlap…
-
We now have a scraper for the FERC Form 6, but need to be able to archive the data on Zenodo. There are two separate sources with non-overlapping coverage:
* [ ] **2000-2020:** DBF files, one per y…
-
We have a scraper for the FERC Form 60, but we need an archiver to go with it:
* [ ] **2006-2020**: DBF zipfiles, one per year
* [ ] **2021-present:** XBRL data published via an RSS feed, one fili…