d4bl / COVID19_tracker_data_extraction

Data is often not collected by Black communities when it is needed the most. We have compiled a list of all of the states that have shared data on COVID-19 infections and deaths by race and those who have not. This effort is to extract this data from websites to track disparities COVID-19 deaths and cases for Black people.
33 stars 7 forks source link

Fix Wisconsin #183

Closed fredtsun closed 3 years ago

fredtsun commented 3 years ago

Fixes #166

Honestly, I don't really understand the primitives for ArcGIS. But our ArcGIS scraper code was super well written and I was able to make out and assume some things about ArcGIS.

By the looks of it, I think they changed their endpoint (is this even the right term for this?) from a FeatureLayerCollection approach to a MapServer approach.

nkrishnaswami commented 3 years ago

😊 Thanks, glad the ArcGIS code was easy to figure out! The flc_id's are things you can find via ArcGIS Online, and are 1-to-1 with URLs. They can be a bit more stable than the URL, and in cases where the ID changes, the URL also changes. My misgiving about them is that the URLs are usually a lot more informative/readable, so I would support switching to URLs as we proceed.

Here's a query and corresponding the info page keyed by id: https://www.arcgis.com/home/search.html?q=owner%3A"DHS_GIS"%20covid&t=content&restrict=false https://www.arcgis.com/home/item.html?id=859602b5d427456f821de3830f89301c

In the lower right, you can see the URL for the layer (table).

fredtsun commented 3 years ago

oooh gotcha gotcha, thanks for the info @nkrishnaswami!