act-now-coalition / can-scrapers

MIT License
9 stars 13 forks source link

Update CDC Monkeypox cases scraper #439

Closed smcclure17 closed 2 years ago

smcclure17 commented 2 years ago

The endpoint that's used to generate the Monkeypox cases page seems to be changing/not be super stable at the moment, causing our data to not always be up to date. This updates the scraper to pull directly from the HTML table on the page, instead of trying to hit the underlying endpoint.

Two examples of the endpoints: https://www.cdc.gov/poxvirus/monkeypox/response/modules/MX-response-case-count-US.json https://www.cdc.gov/poxvirus/monkeypox/modules/data-viz/mpx-maps.json