covidatlas / li

Next-generation serverless crawler for COVID-19 data
Apache License 2.0
57 stars 33 forks source link

Fix SA scraper #440

Closed jzohrab closed 4 years ago

jzohrab commented 4 years ago

Original issue https://github.com/covidatlas/coronadatascraper/issues/890, transferred here on Thursday Apr 23, 2020 at 22:12 GMT


It currently seems to be getting truncated data from the source.

The source was listed as this:

https://datasource.kapsarc.org/explore/dataset/saudi-arabia-coronavirus-disease-covid-19-situation/information/?disjunctive.daily_cumulative&disjunctive.indicator&disjunctive.event&disjunctive.region&disjunctive.city

But that cites a government source which is an arcGIS panel. The services list is here: https://services8.arcgis.com/uiAtN7dLXbrrdVL5/ArcGIS/rest/services

I suggest we change the source to one of these, since it's an official government source.

Also suggest we don't fix it until we merge pagination #889