search

gompertzmakeham / hazardrates

Proactive methodological disclosure of a high resolution precision calibrated estimate of the Gompertz-Makeham Law of Mortality and general utilization hazard rates through lifespan interferometry against annual census data consolidated from the administrative data of all publicly funded healthcare provided in a single geopolitical jurisdiction.
GNU General Public License v3.0
6 stars 0 forks source link

Incorporate Geographic Identifiers and Geometries #2

Open gompertzmakeham opened 5 years ago

gompertzmakeham commented 5 years ago

Incorporating geographic identifiers requires dealing with three thorny data volume problems:

  1. Finding a postal code for each interval for each person. It is not entirely clear what heuristic to use to choose a postal code in the case of multiple choices, particularly because heuristics based on time sorting will be computationally expensive to do at scale.
  2. Finding the local geography code for each postal code requires a non-trivial look-up against a large reference table. Again running this at scale will be computationally punishing.
  3. Finally mapping the local geography code to a geometry requires only a look-up against a relatively small reference table, but then requires incorporating a geometry field.
gompertzmakeham commented 5 years ago

The strategy for efficiently tabulating geography:

  1. Find all unique combinations of days and putative postal codes.
  2. Filter against the postal code list to pull only valid postal codes.
  3. To resolve day collisions take the alphabetically highest postal code because of the behavior to enter unknown postal codes as alphabetically lower postal codes, e.g. T0T0T0.
  4. For each persons semi-annual interval find the postal code at the beginning and the end of the period.
  5. Link in the local geography codes for mapping.