Police-Data-Accessibility-Project / scrapers

Code relating to scraping public police data.
https://pdap.io
GNU General Public License v3.0
157 stars 33 forks source link

Add Dolt support for raw data #134

Closed josh-chamberlain closed 2 years ago

josh-chamberlain commented 2 years ago

This is started here: https://www.dolthub.com/repositories/pdap/data-intake/data/master/raw_data_urls

The ID they are submitting could instead be a URL to a file stored somewhere—generating the UUIDs is just something I do by default now.

We can allow people to submit one-off URLs or find their own way to automate it. Maybe someone will make us a utilities script, but that's a nice to have.

josh-chamberlain commented 2 years ago

Done: https://www.dolthub.com/repositories/pdap/data-intake/data/master/raw_data_urls