some instances of the CDCCovidDataTracker were failing on insertion into the database (put()) because of duplicated entries in the dataframe.
There shouldn't ever be duplicated rows in the scraper output data (as far as I can think of), so this adds a line to remove them. _reshape_variables() is a helper method used by many scrapers (including CDCCovidDataTracker) to format the data
some instances of the
CDCCovidDataTrackerwere failing on insertion into the database (put()) because of duplicated entries in the dataframe.There shouldn't ever be duplicated rows in the scraper output data (as far as I can think of), so this adds a line to remove them.
_reshape_variables()is a helper method used by many scrapers (includingCDCCovidDataTracker) to format the data