Msha extract and transform - Githubissues

catalyst-cooperative / rmi-energy-communities

Partnership between Catalyst and RMI to identify energy communities as defined by the Inflation Reduction Act

MIT License

4 stars 2 forks source link

Msha extract and transform #15

Closed katie-lamb closed 1 year ago

katie-lamb commented 1 year ago

Preliminary MSHA extract and transform step.

The transform filters the MSHA data for the closed coal mine criteria, then merges on the Census tract for each record and all adjacent Census tracts
Maybe the CRS transform here isn't the best way to do this

Found errors in MSHA data that might have impact:

Lat, lon coordinates don't actually correspond to the state listed for the record. This is why some of the states are incorrect when overlapped with the Census geographies (this is mentioned in the CRA report as well).
Multiple records for the same mine (lat, lon coordinates + coal/metal type are the same) with different operational statuses (one record for still active, one for abandoned)
Missing lat, lon coordinates

To Do:

[ ] Add check for mines that are the same lat, lon coordinates but which have different operating statuses. Can be a switch to toggle to see how many mines are excluded if a "campus" of mines still has some active mines
[ ] Impute census tracts of missing lat, lon coordinate mines. Or write up a comment about this.

review-notebook-app[bot] commented 1 year ago

Check out this pull request on

See visual diffs & provide feedback on Jupyter Notebooks.

Powered by ReviewNB