search

NCVotes / voters-ingestor

Django app to create and configure Postgres DB, then fetch and process public voter registration and voter history files from N.C. Board of Elections
MIT License
10 stars 1 forks source link

[WIP] Prototype/Proof-of-concept API for querying a large imported dataset. #17

Closed ironfroggy closed 6 years ago

ironfroggy commented 6 years ago

• voter_add_files.py - new command to manually add a directory of data files that have already been downloaded. • Separated resuming and processing progress bars • Reset line count for every file when processing multiple files in a row • Fix the resume mode finding in-processing files • Added custom JSON field index migrations • Added a status for cancelled files • Ensure changes are sorted with additions before modifications when they happen on the same snapshot • Utilities to build voter data as of any specific change Added new /api/changes/ to query for voters based on when their data changed and, optionally, to what

ironfroggy commented 6 years ago

Assuming CI passes this is ready for another look.