CKAN submission module for scrapers - Githubissues

Police-Data-Accessibility-Project / scrapers

Code relating to scraping public police data.

https://pdap.io

GNU General Public License v3.0

157 stars 33 forks source link

CKAN submission module for scrapers #173

Closed josh-chamberlain closed 11 months ago

josh-chamberlain commented 2 years ago

Task:

[ ] Make a python module to be called at the end of a scraper.py file that takes the output of a scraper and submits it to our CKAN instance. This can be a pretty informal experiment.
[ ] we shouldn't submit the Extraction without a successful archive (see https://github.com/Police-Data-Accessibility-Project/PDAP-Scrapers/issues/180)
[ ] must also submit metadata.py (https://github.com/Police-Data-Accessibility-Project/PDAP-Scrapers/issues/154)

CKAN demo environment:

https://demo.dev.datopian.com/organization/pdap-io

CKAN API info:

https://github.com/ckan/ckanapi https://github.com/ckan/ckanapi#ckanapi-python-module