-
* The extracted XBRL Taxonomy metadata is great! Pretty well structured and rich in information.
* We want to pull a substantial portion of it into the PUDL DB in a normalized way.
* It needs to be …
-
The plant names in the plants_small_ferc1 table are not well standardized -- there is some attempt at cleaning them up so the plant names remain the same from year to year happening in the ferc1 trans…
-
Many of the FERC Form 1 tables of interest report data as a function of both a numbered row, and a named (database) column. Unfortunately, while the database columns have remained almost completely un…
-
The FERC Form 1 is now published as a combination of historical VisualFoxPro DBF databases, and XBRL data, and we need a way to archive them together as a single dataset.
* [ ] **1994-2021Q2:** DBF…
-
### What should we change and why?
We use conda / mamba to manage our data processing environments and simplify working with underlying binary dependencies. We also use Arelle to extract XBRL data …
-
There are several smaller FERC forms that supplement their primary forms (1,2,6,60,714). These supplemental forms include 1F, 3Q Electric, 2A, 3Q Gas, and 6Q. We should be archiving these supplemental…
-
# Electric Operating Revenues
## Exploratory Notes
* The DBF `f1_elctrc_oper_rev` table is split into 2 XBRL tables:
* `electric_operating_revenues_300`
* `electric_operating_revenues_other_…
-
### What happened?
We use Arelle to extract Federal Energy Regulatory Commission filings distributed in XBRL format, and turn them into a relational database covering many utilities across multiple…
-
SQLite only supports simple data types internally, so when we round-trip a dataframe to the DB we lose precious typing information. At least within Dagster, we may be able to work around this by manag…
-
We have tests for some of the datasets, but not others. EIP Infrastructure and FERC 714 seem to be missing. At the same time, we still have a test for the deprecated EPA IPM data.
Do we feel like t…