-
In the process of doing the EIA 923 data integration for 2018 (#420) and generating PUDL IDs for FERC/EIA (#428), I discovered that somehow there's 167 EIA plants which appear in the ID Mapping spread…
-
Mostly because I'm curious, but also in case pandas' `to_sql` dramatically improves in the future. (For new users, it would be nice if all the packages were in Anaconda or at least conda-forge. sqlal…
-
Currently the `epacems` type is set up to download the hourly CEMS data. Would you also like to download the daily? I've heard, but can't confirm, that the hourly and daily sometimes differ (possibl…
-
I want to pose a high level design question to folks here for discussion.
In the beginning of this project, we thought that the database itself, which our software currently populates, was going to…
-
Now that we have the data importing into the PUDL DB, and at least of the right type and structure, we need to start looking at whether the values are meaningful, and either fixing things that are bro…
-
Once the generation of the data package process is complete (issue #293), we'll need to transition the load step to take:
- the dictionary of transformed dataframes
- prepped metadata (static projec…
-
For each of the EIA 860 data tables, we need to create a suite of data validity tests -- at least high level sanity checks -- that can be run to ensure nothing weird has happened that's affected the c…
-
We have functions for automatically slurping database tables from the old DBF format into postgres, but we haven't tried to use them on all of the old DBF tables. We might as well give all of the old…
-
#### Issue
The hourly CEMS times are in local ("naive") timezones, which makes things tricky when you try to line them up with other data sources.
#### Proposed solution
- During ETL, convert…
-
Hi guys,
We are experimenting with SOEM on linux. After some changes in the redtest we are able to rotate the motor.
We are using Xenomai in our system. After testing the code we found that the …