Remove pudl postgres database!!

catalyst-cooperative / pudl

The Public Utility Data Liberation Project provides analysis-ready energy system data to climate advocates, researchers, policymakers, and journalists.

https://catalyst.coop/pudl

MIT License

456 stars 106 forks source link

Remove pudl postgres database!! #363

Closed cmgosnell closed 4 years ago

cmgosnell commented 4 years ago

Once we are at the point of converting over fully to data packages, there will be lots of things we need to get rid of which reference the database that will no longer be relevant...

[x] models! all of them...
[x] all the functions tagged with Remove upon removal of pudl_db todo's
[x] postgres dependencies
[x] init.py
- [x] the db connections
- [x] everything else!
[x] a bunch of tests.
[x] any keep_csv reference

I'm sure there is more...

cmgosnell commented 4 years ago

Hey @karldw! are you using the views for CEMS? It looks like they can be easily converted away from using the models' metadata definition but I figured I should check in with you about it before spending the time converting them to use the new sqlite database instead of the postgres database. (Also, I'm pretty sure this will be easy to do but if you have any insight on why this might be difficult that would be swell too).

karldw commented 4 years ago

I'm not! I've moved to an all-parquet workflow. Thanks for checking! (I agree that it wouldn't be too hard to convert, but there's no need.)