Closed josh-chamberlain closed 10 months ago
Release v1 of a package which allows a volunteer to both donate compute time to PDAP and run scrapers for their own benefit.
donate compute time to PDAP
run scrapers for their own benefit
This is achieved adding things to the existing PDAP-app repo and probably deploying it to app.pdap.io or a local version.
PDAP-app
app.pdap.io
This may be some kind of Docker file.
The package should include all necessary dependencies.
Should include Datasets Search (https://github.com/Police-Data-Accessibility-Project/PDAP-Datasets-App/issues/1)
Users should be able to "Run Scraper Locally" on any Dataset they find that has a Scraper.
The Extractions should be sent to the Intake API https://github.com/Police-Data-Accessibility-Project/PDAP-Scrapers/issues/80
[ ] https://github.com/Police-Data-Accessibility-Project/PDAP-Scrapers/issues/127
[ ] https://github.com/Police-Data-Accessibility-Project/PDAP-Datasets-App/issues/3
[ ] https://github.com/Police-Data-Accessibility-Project/PDAP-Scrapers/issues/121
[ ] https://github.com/Police-Data-Accessibility-Project/PDAP-Scrapers/issues/142
Thread about Executable Scrapers: https://discord.com/channels/828274060034965575/850707163861221437/1001902322659627148
replaced by https://github.com/Police-Data-Accessibility-Project/PDAP-Scrapers/issues/214
Release v1 of a package which allows a volunteer to both
donate compute time to PDAP
andrun scrapers for their own benefit
.This is achieved adding things to the existing
PDAP-app
repo and probably deploying it toapp.pdap.io
or a local version.This may be some kind of Docker file.
The package should include all necessary dependencies.
Should include Datasets Search (https://github.com/Police-Data-Accessibility-Project/PDAP-Datasets-App/issues/1)
Users should be able to "Run Scraper Locally" on any Dataset they find that has a Scraper.
The Extractions should be sent to the Intake API https://github.com/Police-Data-Accessibility-Project/PDAP-Scrapers/issues/80
[ ] https://github.com/Police-Data-Accessibility-Project/PDAP-Scrapers/issues/127
[ ] https://github.com/Police-Data-Accessibility-Project/PDAP-Datasets-App/issues/3
[ ] https://github.com/Police-Data-Accessibility-Project/PDAP-Scrapers/issues/121
[ ] https://github.com/Police-Data-Accessibility-Project/PDAP-Scrapers/issues/142