search

datamade / court-scrapers

MIT License
2 stars 0 forks source link

Write Makefile for nightly scraping #15

Closed fgregg closed 6 months ago

fgregg commented 7 months ago
  1. download the password-protected, zipped database from where it's stashed in a release
  2. unzip the database
  3. decide what to scrape
  4. scrape it
  5. update the database
  6. password protect it as a zip file
  7. push it back up to the same location

use the NLRB-data repo as a model