The Public Utility Data Liberation Project provides analysis-ready energy system data to climate advocates, researchers, policymakers, and journalists.
Interim table transforms in pudl.output.ferc714 should use the standard io manager
compile_geoms() should have a factory function, iterating over entity type. The save to geoparquet function has been flaky, if we are able to get it working we could use geoparquet and write a geoparquet io manager. Otherwise, we can strip geometry and save as a table. Extensive additional work on the geometrical component is a low priority in this iteration of the transition.
Whatever is implemented in state_demand.py should be used as a default for the ba_ids and util_ids, but these should be parameters passed in by dagster's context to enable manual changes.
Best order to implement change in: service_territory -> FERC 714 -> state_demand
Rip out the Respondents class in pudl.output.ferc714
In pudl.output.ferc714, the summarize_demand and fipsify tables are the best candidates for inclusion into PUDL. The other two tables are just upstream intermediate outputs.
e-belfer
commented
1 year ago
Notes on how to do this:
pudl.output.ferc714should use the standard io managercompile_geoms()should have a factory function, iterating over entity type. The save to geoparquet function has been flaky, if we are able to get it working we could use geoparquet and write a geoparquet io manager. Otherwise, we can strip geometry and save as a table. Extensive additional work on the geometrical component is a low priority in this iteration of the transition.state_demand.pyshould be used as a default for theba_idsandutil_ids, but these should be parameters passed in by dagster'scontextto enable manual changes.Respondentsclass inpudl.output.ferc714pudl.output.ferc714, thesummarize_demandandfipsifytables are the best candidates for inclusion into PUDL. The other two tables are just upstream intermediate outputs.