Created an initial script and supporting files for doing the committee/candidate linking.
Main script for doing the cleanup is:
-ncopenpass-committee-clean.py
Setup for running script would be to do the following:
make env
make data-pull
run script (ncopenpass-committee-clean.py) in REPL and iterate as necessary
Right now the workflow is just to evaluate in a REPL and possibly dump out to clipboard and into e.g. LibreOffice Calc for inspection, but no IO is happening yet. Script assumes committee data is present in the s3-data directory (which it should be if make data-pull has been run), manual editing is done by changing this manual_override.csv file in order to have it update at the last stage of the process.
Supporting files for setup/running are:
Makefile: recipes for related tasks (downloading data via wget, creating/deleting conda environment, etc.)
csv-data-files.txt: list of current data files pulled by wget recipe in Makefile
environment.yml: environment YAML file
manual_override.csv: CSV file containing entries to manually fix names, must use the original comittee name in order for the last step of join and update to work correctly; currently just contains 1 entry for BUTTERBALL PAC from initial testing
Created an initial script and supporting files for doing the committee/candidate linking.
Main script for doing the cleanup is: -
ncopenpass-committee-clean.pySetup for running script would be to do the following:
make envmake data-pullncopenpass-committee-clean.py) in REPL and iterate as necessaryRight now the workflow is just to evaluate in a REPL and possibly dump out to clipboard and into e.g. LibreOffice Calc for inspection, but no IO is happening yet. Script assumes committee data is present in the
s3-datadirectory (which it should be ifmake data-pullhas been run), manual editing is done by changing thismanual_override.csvfile in order to have it update at the last stage of the process.Supporting files for setup/running are: