Open jzohrab opened 4 years ago
In https://github.com/covidatlas/coronadatascraper/pull/889, @shaperilio made changes to many scrapers that potentially needed to handle arcgis pagination to get all their data.
We've enabled arcgis pagination here in Li -- eg, see https://github.com/covidatlas/li/blob/master/src/shared/sources/jp/index.js -- and we potentially need to do the same for the sources that were touched in the original PR 889:
src/shared/scrapers/JP/index.js src/shared/scrapers/LT/index.js src/shared/scrapers/LV/index.js src/shared/scrapers/LV/mapping.json src/shared/scrapers/PA/index.js src/shared/scrapers/SE/index.js src/shared/scrapers/TH/index.js src/shared/scrapers/US/AR/index.js src/shared/scrapers/US/CT/index.js src/shared/scrapers/US/DE/index.js src/shared/scrapers/US/ID/index.js src/shared/scrapers/US/LA/index.js src/shared/scrapers/US/MA/index.js src/shared/scrapers/US/MN/index.js src/shared/scrapers/US/MT/index.js src/shared/scrapers/US/NV/washoe-county.js src/shared/scrapers/US/TN/index.js src/shared/scrapers/US/VT/index.js src/shared/scrapers/US/WA/index.js
Description
In https://github.com/covidatlas/coronadatascraper/pull/889, @shaperilio made changes to many scrapers that potentially needed to handle arcgis pagination to get all their data.
We've enabled arcgis pagination here in Li -- eg, see https://github.com/covidatlas/li/blob/master/src/shared/sources/jp/index.js -- and we potentially need to do the same for the sources that were touched in the original PR 889: