Write up Split, Recode, Aggregate Workflow (INDSTAT)

[cynthiahqy]

For a single country, the INDSTAT conversion I did to extend TPP data involved:

• split isiccomb values to isic3 by equal_shares
• resolve 3-digit & 4-digit discrepancies:
  • append total_diff_3_less_4 = 3dig - sum(4dig) column with difference of 3-digit reported total over the 4-digit calculated totals.
  • append censored_diff column, which is 0 if 4-digit total was larger, and >0 if 3-digit total was larger.
  • split censored_diff values from 3dig to 4dig by equal_shares
  • combine censored_diff + isic3_4dig into adjusted isic3_4dig values.
• recode isic3_4dig values to isic2_4dig by mixed_weights, where mixed_weights included equal shares for 1-to-many links.
• aggregate isic2_4dig values to isic2_3dig for analysis

[cynthiahqy]

This is not a good example since the data are not open license

[cynthiahqy]

Comparison: https://cynthiahqy.github.io/indstat-TPP/001-clean_INDSTAT.html