act-now-coalition / covid-data-model

Data backend providing computed data for the graphs displayed at https://covidactnow.org
https://covidactnow.org/
MIT License
149 stars 57 forks source link

touched_subset only returns time series with dropped observations #1115

Closed TomGoBravo closed 3 years ago

TomGoBravo commented 3 years ago

This PR is last remaining part of https://trello.com/c/1p0uTkYH/1300-pipeline-generate-csv-of-blocked-metrics-and-make-it-easy-for-data-dashboard-to-read-it

Follow up on https://github.com/covid-projections/covid-data-model/pull/1108#issuecomment-842694398 to only put timeseries that actually had observations dropped in data/manual_filter_removed-wide-dates.csv

This also fixes a test breakage introduced by 08fe29e1834.

Tested

Ran ./run.py data update with main c76029ee merged in and covid-data-public in sync. Changes only seen in data/manual_filter_removed-wide-dates.csv. They are removal of CA county cases, CT state tests, IL county vaccine, NY state and county tests. This matches what is blocked: false in data/region-overrides.json

TomGoBravo commented 3 years ago

Pipeline: Generate CSV of blocked metrics and make it easy for data dashboard to read it.