Police-Data-Accessibility-Project / scrapers

Code relating to scraping public police data.
https://pdap.io
GNU General Public License v3.0
157 stars 33 forks source link

ETL into pdap/data-intake #113

Closed EricTurner3 closed 3 years ago

EricTurner3 commented 3 years ago

ETL Package refactored to read from schema.json file and will now:

Still work-in-progress:

EricTurner3 commented 3 years ago

Successfully loaded data into DoltHub!

EricTurner3 commented 3 years ago

I updated my settings to Insert NewLines and will do PEP8 formatting and unit tests in the next PR. I just do not want to increase this PR as it functionally is working fine and our pipeline does not currently have specific formatting requirements.