Figure out how to model vaccination data

[Mr0grog]

Three bay area counties now have vaccination dashboards:

• San Francisco: https://data.sfgov.org/stories/s/COVID-19-Vaccinations/a49y-jeyc
• Santa Clara: https://www.sccgov.org/sites/covid19/Pages/dashboard-vaccine.aspx
• Contra Costa: https://www.coronavirus.cchealth.org/vaccine-dashboard
• Marin: https://coronavirus.marinhhs.org/surveillance#vaccines (bottom of the main dashboard page)
• Alameda: https://covid-19.acgov.org/data.page
• San Mateo: https://www.smchealth.org/data-dashboard/vaccination-totals-locations-data
• Napa: https://insight.livestories.com/s/v2/napa-blue-print/580e970f-981c-410f-959c-037b066244d6 (Note this one does not seem particularly scrapable at this point. It’s mostly images. 😞)

We need to figure out how to best represent this data in our scraper output. What’s common between these dashboards? What’s different? What’s most important?

---

Updated 2021-01-22: Added Marin County Updated 2021-02-05: Added Alameda, San Mateo, Napa from @kengo-sony

[Mr0grog]

Marin is also now including vaccination data at the bottom of their main dashboard page: https://coronavirus.marinhhs.org/surveillance#vaccines

[kengo-sony]

Found three more counties that have vaccination dashboards

• Alameda: https://covid-19.acgov.org/data.page
• San Mateo: https://www.smchealth.org/data-dashboard/vaccination-totals-locations-data
• Napa: https://insight.livestories.com/s/v2/napa-blue-print/580e970f-981c-410f-959c-037b066244d6

[Mr0grog]

Interesting discovery: the state is currently publishing some good data on their vaccinations page at: https://covid19.ca.gov/vaccines/. For each county, they’ve got:

• Total vaccinations administered
• % Administered by age
• % Administered by gender
• % Administered by race/ethnicity

Some counties are definitely not publishing these stats (some counties we haven’t identified a dashboard/dataset for at all), and this also gives us a standard set of categories. Using this state data might be the place to start for now.

Downsides:

• This data is not in the state open data portal or Snowflake (yet?)
• None of the data points are offered in timeseries form, so we need to build a timeseries ourselves by scraping daily.

Since we need to build the timeseries ourselves and because the state data covers a broader set of counties than we do here, I went ahead and started the ball rolling at https://github.com/Mr0grog/ca-covid-vaccination-stats. If that works out well, we should see about integrating the code (or just the data) here.

[Lynguyen237]

@Mr0grog Rob, how did your attempt to build time series data from the state website go? I took a stab at documenting the metrics provided by each county here (not finished) and I think if the state already has the data and common metrics shared by all counties, that would be our best bet: https://docs.google.com/spreadsheets/d/1fhdF587nhBlychWvmMwPs2PwGy9ffqiH06ZZhEitVfo/edit#gid=262116661

[Mr0grog]

The state is now publishing timeseries data for all the same info I was scraping at: https://data.ca.gov/dataset/covid-19-vaccine-progress-dashboard-data

I think you should probably just use the new state dataset; a quick glance over your spreadsheet makes it look like the state data feeds or my scraper both cover all the stats you’ve listed (except neighborhood), but for all counties.