Post Processing Checks and notebook

[nofurtherinformation]

QA/QC postprocessing with the following changes:

• Removing quotes on columns where not needed (Eg. DS05_S.csv)
• Removing extraneous index columns (Eg. EC04_S.csv)
• Adds leading Zeroes wherever relevant (Eg. BE01_S.csv)
• Rounds to 2 decimals across all files (Eg. DS05_S.csv)
• Correcting 'GISJOIN' column to relevant geography (COUNTYFP, ZCTA, etc.) and removing leading 'G' (Eg. DS05_S.csv)

Outcomes:

• Data file size for all CSVs decreases by approximately 40MB (~178MB => ~138MB)
• Import issues with character encoding solved (Pandas required non-utf8 import parameter)
• Data consistency and formatting pipeline for post-processing established

[nofurtherinformation]

See Jupyter Notebook here with functions used to post-process data.

[nofurtherinformation]

Found an error with STATEFP paddings. Closing temporarily.