catalyst-cooperative / pudl

The Public Utility Data Liberation Project provides analysis-ready energy system data to climate advocates, researchers, policymakers, and journalists.
https://catalyst.coop/pudl
MIT License
456 stars 106 forks source link

Debug issues with PudlTabl output objects and direct to SQLite outputs #1201

Closed zaneselvans closed 2 years ago

zaneselvans commented 2 years ago

The database produced by the direct-to-sqlite ETL is (at leaset) slightly different from the old datapackage based database, and this is causing issues with the pudl_out / PudlTabl class that we rely on to pull denormalized data tables from the database. We can't run the tests without the outputs working, so this means we don't know how broken everything is with the new DB 😅 See #1195

Known problems

zaneselvans commented 2 years ago

Thankfully, once the tests were up and running, it seems like all the current output routines, mcoe etc. work fine -- just those ID column references needed to be removed.