-
We've got veritable 🤡 🚗 of EIA fuel type codes categorized in the current `pudl.constants` module, with a different dictionary for each table in which they appear, so we can simplify them when we crea…
-
With foreign key constraint checking turned on, we get integrity errors during the main ETL. The first errors are related to tables where the foreign key and primary key have different names. E.g. the…
-
In many of our older EIA transformation functions, we pre-emptively drop columns from the tables that are being processed, in order to produce normalized tables. However, many of these columns contai…
-
The database produced by the direct-to-sqlite ETL is (at leaset) slightly different from the old datapackage based database, and this is causing issues with the `pudl_out` / PudlTabl class that we rel…
-
Aggregating net generation by month, but without filling in any missing data, we get 476k records, of which 451k have non-null `net_generation_mwh` values:
```py
pudl_out_ms = pudl.output.pudltabl.P…
-
Create a process analogous to Christina's work on the net generation side of things for combining fuel consumption from the `boiler_fuel_eia923` table and the `generation_fuel_eia923` table along with…
-
We have the option of filling in missing `net_generation_mwh` values in the `pudl_out.gen_eia923()` method, which is enabled by setting `fill_net_get=True` in the creation of the `pudl_out` object.
…
-
## Where is the Data Source metadata now
* `pudl/metadata/sources.py` (where we're trying to consolidate it)
* `pudl-zenodo-storage/zs/metadata.py`
* Some subcomponents are defined in `pudl/metadat…
-
A review of the field metadata in `src/pudl/package_data/meta/datapkg/datapackage.json` reveals the following inconsistencies in `constraints.enum` and `description` for fields of the same name across…
-