The Public Utility Data Liberation Project provides analysis-ready energy system data to climate advocates, researchers, policymakers, and journalists.
Interim table transforms in pudl.output.ferc714 should use the standard io manager
compile_geoms() should have a factory function, iterating over entity type. The save to geoparquet function has been flaky, if we are able to get it working we could use geoparquet and write a geoparquet io manager. Otherwise, we can strip geometry and save as a table. Extensive additional work on the geometrical component is a low priority in this iteration of the transition.
Whatever is implemented in state_demand.py should be used as a default for the ba_ids and util_ids, but these should be parameters passed in by dagster's context to enable manual changes.
Best order to implement change in: service_territory -> FERC 714 -> state_demand
Rip out the Respondents class in pudl.output.ferc714
In pudl.output.ferc714, the summarize_demand and fipsify tables are the best candidates for inclusion into PUDL. The other two tables are just upstream intermediate outputs.
Notes on how to do this:
pudl.output.ferc714
should use the standard io managercompile_geoms()
should have a factory function, iterating over entity type. The save to geoparquet function has been flaky, if we are able to get it working we could use geoparquet and write a geoparquet io manager. Otherwise, we can strip geometry and save as a table. Extensive additional work on the geometrical component is a low priority in this iteration of the transition.state_demand.py
should be used as a default for theba_ids
andutil_ids
, but these should be parameters passed in by dagster'scontext
to enable manual changes.Respondents
class inpudl.output.ferc714
pudl.output.ferc714
, thesummarize_demand
andfipsify
tables are the best candidates for inclusion into PUDL. The other two tables are just upstream intermediate outputs.