WA scraper data was off by one, causing unknown doses to be stored in the white bucket, white doses in the ai_an bucket and so forth:
context w/ Surgo:
It looks like our scraper broke over the last couple of days. In short, something changed with the dashboard, and the keys we use to extract each demographic and dose value became off by one causing us to put data in the wrong columns/bins. (So the data in the unknown bucket above is actually the data for the white bucket). The data up until after 11/15 appears to be correct. I’m shipping a quick fix for this right now, and will push the new data through the pipeline. I’ll make changes to the scraper, too, to secure it against this kind of problem in the future.
The "changes to the scraper ... to secure it against this kind of problem in the future" will come in the next PR
WA scraper data was off by one, causing
unknowndoses to be stored in thewhitebucket,whitedoses in theai_anbucket and so forth:context w/ Surgo:
The "changes to the scraper ... to secure it against this kind of problem in the future" will come in the next PR