search

sfbrigade / data-covid19-sfbayarea

Manual and automated processes of sourcing data for the stop-covid19-sfbayarea project
MIT License
8 stars 10 forks source link

Switch Marin to Use New Data Portal #165

Closed Mr0grog closed 3 years ago

Mr0grog commented 3 years ago

We currently get data for Marin county by scraping their dashboard using Selenium, but @1ec5 pointed out that Marin has recently set up a Socrata-powered dashboard with COVID data found at: https://data.marincounty.org/browse?q=covid

This ought to be a much better and easier to use source of data, so we should rewrite the Marin scraper to use Socrata instead. This may also obviate #162 (I haven’t dug in to see how unknown demographic categories are or are not accounted for in the data portal).

If you are new to the codebase and are implementing this, you might want to check out the implementation for two other counties that are Socrata-based:

Mr0grog commented 3 years ago

Actually, this is a more urgent issue than I’d realized — the dashboard page has had all its charts totally re-done with Tableau, so our existing scraper no longer works at all, so this issue really needs to be addressed ASAP.