This PR fixes the issue #24 where data may be missing if the scrape date range is especially large.
The changes are:
The scraper will now recursively 'page' through cases to circumvent the hard 200 record limit.
A new CLI argument, --days specifying how many days worth of case data to scrape. It is optional, and defaults to 90 days. For example: python dekalb_scraper.py --days 180 --output json.
A new dependency. The scraper now uses the 'click' package for CLI parsing.
This PR fixes the issue #24 where data may be missing if the scrape date range is especially large.
The changes are:
--daysspecifying how many days worth of case data to scrape. It is optional, and defaults to 90 days. For example:python dekalb_scraper.py --days 180 --output json.