The Public Utility Data Liberation Project provides analysis-ready energy system data to climate advocates, researchers, policymakers, and journalists.
Even after we move to a datapackage based endpoint for the ETL process, we will still need to spin up some kind of DB to clone the FERC database out of its FoxPro jail. In order to keep the overall setup and dependencies of PUDL as simple as possible, it seems like switching to using SQLite instead of Postgresql would probably be a good idea.
Should we keep using SQLAlchemy for this? It seems like there's probably a lighter-weight way to go about it.
swinter2011
commented
5 years ago
Even after we move to a datapackage based endpoint for the ETL process, we will still need to spin up some kind of DB to clone the FERC database out of its FoxPro jail. In order to keep the overall setup and dependencies of PUDL as simple as possible, it seems like switching to using SQLite instead of Postgresql would probably be a good idea.
Should we keep using SQLAlchemy for this? It seems like there's probably a lighter-weight way to go about it.