search

datamade / bga-payroll

💰 How much do your public officials make?
4 stars 4 forks source link

use canonical list of employers to link data across years #192

Open hancush opened 6 years ago

hancush commented 6 years ago

noting this for multi-year support in phase 2.

bga maintains a canonical list of responding agency / employer (virtually always the same) with unique identifiers, and uses it to link inconsistent representations of the same employer across years, by including the unique identifier in the payroll data.

assuming this list looks the way i think it does, this could replace at least one round of review.

further, investigate whether a list like this could be produced for departments (or, at least, a portion of large departments, i.e., the chicago police department.)

hancush commented 6 years ago

behold: the canonical list.

hancush commented 4 years ago

The canonical list is a lookup table of responding agencies to their ID. One responding agency can provide records for multiple employers, e.g., ISBE provides payroll for schools. Not sure we can use this in the way I had hoped.