beansrowning / dxy-covid19

A daily automated pull from the DXY COVID-19 dataset from BlankerL
0 stars 2 forks source link

Stand-up web scraper internally #2

Open beansrowning opened 4 years ago

beansrowning commented 4 years ago

Problem

BlankerL's API is toast due to sheer volume of requests. I've forked the webscraper code and begun installation on my own system where I can run indefinitely.

Once this is done, I should be able to point to a local database for the upstream data.

For now, I've pointed to the BlankerL GitHub data warehouse JSON files.

beansrowning commented 4 years ago

Running on local machine.