Open zaneselvans opened 1 year ago
Not sure if this is the right place for this, but here are some errors in FERC 714 data, table planning_area_hourly_demand_and_forecast_summer_and_winter_peak_demand_and_annual_net_energy_for_load_table_03_2_duration
Also, the filing names do not match the respondent names in the historical FERC 714 database (through 2020). There is also no number to cross-track between the two, somehow the entity_id seems to be different from the two IDs referenced in the archived FERC database.
Thank you for compiling the list of weirdness @Wilson-Energy!
Unfortunately there's no ID that directly links the old and new data, and we've had to manually map those relationships in the FERC Form 1, so I imagine we'll need to do something similar for the FERC-714 to get continuous time series that cover the whole span of years.
We've got a bunch of new tables in the DB! We should figure out some criteria for validating them. We should restrict this to only the close-to-finished tables that we've actually done a lot of work on. The other
raw_
andclean_
tables aren't expected to be valid yet.Validations to include: