search

covidatlas / li

Next-generation serverless crawler for COVID-19 data
Apache License 2.0
57 stars 33 forks source link

Scraper for St. Louis County, MO #543

Open slezakbs opened 4 years ago

slezakbs commented 4 years ago

Looks like the St. Louis County data on the MO health site is lagging behind. More accurate data is being linked on the county page: STL County Covid-19 Home: https://stlouisco.com/Your-Government/County-Executive/COVID-19 Arc Map: https://stlcogis.maps.arcgis.com/apps/MapSeries/index.html?appid=6ae65dea4d804f2ea4f5d8ba79e96df1

@paulboal I noticed you are the maintainer of MO scraper so wanted to bring this to your attention. I'm going update on my forked repo. Will happily create a PR when I'm finished if this source benefits you all as well.

jzohrab commented 4 years ago

Hi @slezakbs , a long-overdue response. Did you get your PR working? We have a us/mo/st-louis-county.js in this repo which is referring to https://services2.arcgis.com/w657bnjzrjguNyOy/ArcGIS/rest/services/StLouisCounty_Bdy_Geo/FeatureServer/0/query, but the data doesn't look great from it when run locally:

Local cache hit for: us-mo-st-louis-county / 2020-08-09
┌─────────┬─────────────────────────────────┬──────────────┬───────┬────────┬───────────┬────────────────────────────┐
│ (index) │           locationID            │     date     │ cases │ deaths │ recovered │       publishedDate        │
├─────────┼─────────────────────────────────┼──────────────┼───────┼────────┼───────────┼────────────────────────────┤
│    0    │ 'iso1:us#iso2:us-mo#fips:29189' │ '2020-08-09' │   0   │   0    │   9438    │ '2020-08-08T14:45:00.000Z' │
└─────────┴─────────────────────────────────┴──────────────┴───────┴────────┴───────────┴────────────────────────────┘
Scrape: us-mo-st-louis-county / 2020-08-09: 23.198ms

I don't like the way it's interpreting data, and these numbers don't look anything like what a google search returns. Thoughts?

cheers, jz

slezakbs commented 4 years ago

Apologies, it's been a while since I've had a chance to look at this. It was working... but looks like they changed what they are tracking. (only testing data and new cases)

Going through the St. Louis County site leads me here now: https://stlcorona.com/resources/covid-19-statistics1/ Although it appears there have been some improvements on the Missouri State site http://mophep.maps.arcgis.com/apps/MapSeries/index.html?appid=8e01a5d8d8bd4b4f85add006f9e14a9d