Fix data quality issues discovered during schema creation

deployment-gap-model-education-fund / deployment-gap-model

ETL code for the Deployment Gap Model Education Fund

https://www.deploymentgap.fund/

MIT License

6 stars 2 forks source link

Closed bendnorman closed 9 months ago

bendnorman commented 1 year ago

Adding SQLAlchemy schemas revealed some small data quality issues.

Data Warehouse Issues: See discussion in this pr.

Data Mart Issues:

[x] proposed_power_dash_existing_plants: county_id_fips is a part of the pk but is missing 9 values.
[x] proposed_power_dash_proposed_plants: county_id_fips and resource are both a part of the pk but missing 9 values.
[x] co2_dashboard: Should be a part of the pk but is missing one value.

TrentonBush commented 9 months ago

These tables are obsolete; were removed in #250