covidatlas / li

Next-generation serverless crawler for COVID-19 data
Apache License 2.0
57 stars 33 forks source link

Migrate Marin County, California, from ArcGIS to DataWrapper #604

Open 1ec5 opened 3 years ago

1ec5 commented 3 years ago

The Marin County, California, scraper at https://github.com/covidatlas/li/blob/master/src/shared/sources/us/ca/marin-county.js still functions, but the county is no longer updating that ArcGIS FeatureServer. Instead, we’ll have to fall back to the DataWrapper charts that power the county’s interactive report webpage. For example, the main cases/deaths/hospitalizations/recoveries chart is at https://datawrapper.dwcdn.net/Eq6Es/ – or rather, the page that it redirects to via a meta redirect.

Here’s a quick-and-dirty scraper as a Bash script:

https://github.com/1ec5/external-data-bot/blob/4bde4ad88cbf5d3f1bbc0e2cc49b57c738144836/scripts/covid19/US/CA/marin-county.sh#L10

TomGoBravo commented 3 years ago

I noticed that several metrics including tested don't have any real values after 8/31 in many California counties. Marin and Sonoma (fips:06097) are two examples. Is that related to this bug?