catalyst-cooperative / pudl

The Public Utility Data Liberation Project provides analysis-ready energy system data to climate advocates, researchers, policymakers, and journalists.
https://catalyst.coop/pudl
MIT License
476 stars 110 forks source link

Convert ETL to use Dagster software defined assets #1570

Closed bendnorman closed 1 year ago

bendnorman commented 2 years ago

We are converting our ETL to use dagster software defined assets so tables can be cleaned and persisted in parallel. Here are the main goals of this epic:

zaneselvans commented 1 year ago

This issue was largely subsumed by #2246