-
In order to enable github action testing (bc everything is too beeeg).
Run through each processing step, diagnose current issues blocking 1-year processing and implement solution:
- [x] `pudl_rmi.coo…
-
## Background
In order to ingest XBRL data into PUDL, we need a datastore that can interpret XBRL archives (#1593). The archives consist of a set of XBRL filings, and some metadata pulled from the RS…
-
FERC recently released a notice that only the most recent 650 XBRL filings will be available through their RSS feed at any given time -
> The eForms Accepted Filings RSS feed has been modified to …
-
As soon as the nightly builds succeed on `dev` we'll be ready to merge into `main` and tag a new PUDL release that includes all 2021 data for all of our covered datasets.
## Release Checklist / Not…
-
Scope:
* [x] merge `dev` into `dagster_asset_etl`
* [ ] write script (potentially using sqlitediff) to compare legacy/dagster pudl.sqlites.
-
# conversions from old transform to new
- [x] _clean_cols ->
- [x] `Ferc1AbstractTableTransformer.assign_record_id` deployed in `Ferc1AbstractTableTransformer.process_dbf` and `Ferc1AbstractTable…
-
Figure out how to link utilities / respondents in the old and new data using some combination of `respondent_id`, `utility_id_ferc1` and the new company IDs that appear in the XBRL data.
We may be …
-
## Background
To simplify the archiving/scraping processes, and to enable automation of these processes, we should combine the archiver/scraper repos. These two repos are already tightly bound, as th…
-
```
```
https://github.com/z-shell/wiki/blob/3b250cea54de117e23d0998d5416614e3fa7de0c/ecosystem/annexes/1_bin_gem_node.md?plain=1#L307
-
## Table Notes
```py
elec_energy_acct_dbf = pd.read_sql("f1_elctrc_erg_acct", ferc1_engine)
elec_energy_acct_xbrl = pd.read_sql("electric_energy_account_401a_duration", ferc1_xbrl_engine)
```
…