-
Dagster ConfigSchema and the CLI might remove the need for pudl entry points like `pudl_etl` and `epacems_to_parquet`.
Files to remove:
- [x] CLI Commands: We need to decide if we want to continu…
-
Hi Dave, Thanks again for your great work here.
from @Mattsag
> I had a look at the data today and noted some odd things:
> (1) there are many cases that have a byte count of less than 500 where…
-
## Table Notes:
* A single DBF table maps to 4 different XBRL tables. 2 have only duration facts, one has only instant, and one has both duration and instant facts:
* `accumulated_provision_for_de…
-
This issue is to discuss how we want to the work in the Prefect branch #901 in.
## Questions
**1. What are our top infrastructure issues? Does the Prefect branch get us closer or further to add…
-
Most of the code being migrated will be in `pudl.analysis.allocate_net_gen`
There are 3 versions of the net gen allocated table:
* `gen_fuel_by_generator_energy_source` is the primary table from w…
-
Old FERC Form 714 data is published as a collection of CSVs. New FERC Form 714 data is published as XBRL. We need an archiver that can store both formats.
* [ ] **2006-2020:** CSV files (exported f…
-
Currently the `dbf2sqlite` function:
1. Drops existing tables from the ferc1.sqlite db using `pudl.helpers.drop_tables()`
2. Gathers ferc1 table names using `pudl.extract.ferc1.get_dbc_map()`
3. `d…
-
## Table Notes
* Has both instant and duration tables in XBRL
* Instant table has "end of last year" and "end of this year"
* Terrible disaster of a shared index column `other_regulatory_liability_…
-
* The extracted XBRL Taxonomy metadata is great! Pretty well structured and rich in information.
* We want to pull a substantial portion of it into the PUDL DB in a normalized way.
* It needs to be …
-
The plant names in the plants_small_ferc1 table are not well standardized -- there is some attempt at cleaning them up so the plant names remain the same from year to year happening in the ferc1 trans…