Prioritize county dashboard scrapers over The Mercury News

covidatlas / li

Next-generation serverless crawler for COVID-19 data

Apache License 2.0

57 stars 33 forks source link

Prioritize county dashboard scrapers over The Mercury News #383

Closed 1ec5 closed 4 years ago

1ec5 commented 4 years ago

I just realized the Mercury News scraper has a priority of 1, which is the same as the Santa Clara County scraper added in #375. That might explain why the spike in deaths in https://github.com/covidatlas/li/issues/363#issuecomment-670172011 still shows up despite there being more accurate county dashboard scrapers. This PR increases the priorities of the Santa Clara County and San Francisco scrapers above the Mercury News scraper’s priority.

jzohrab commented 4 years ago

I think this is reasonable.

For the v2 reports, I'd like to output all of the data that we have, in addition to a merged-by-priority report. Users can/should choose how they want to interpret the data.

Thanks!