catalyst-cooperative / rmi-ferc1-eia

A collaboration with RMI to integrate FERC Form 1 and EIA CapEx and OpEx reporting
MIT License
3 stars 3 forks source link

formatting test data #19

Closed cmgosnell closed 4 years ago

cmgosnell commented 4 years ago

We need to convert rmi's test data linkages to be in the same format as whatever we feed the matching model.

I think this means we need to do three main things:

zaneselvans commented 4 years ago

I don't know if it's helpful here, but we generate a unique record ID for each FERC record that gets pulled into PUDL (with the exception of the new row-mapped tables like Plant in Service) that has the format: {table_name}_{report_year}_{report_prd}_{respondent_id}_{spplmnt_num}_{row_number}