reichlab / covidHubUtils

Utility functions for the COVID-19 forecast hub
http://reichlab.io/covidHubUtils/
17 stars 16 forks source link

test failures when running check() on a local copy of the package #408

Closed bsweger closed 7 months ago

bsweger commented 8 months ago

As part of onboarding to this code base, I encountered a test failure when running the test suite:

We're not seeing similar failures when the tests run as part of CI because the GitHub actions task only runs these when the related code has been updated (e.g., if there's been a change in get_truth.R).

Digging into the first failure, it seems that starting in October 2022, the truth data being loaded via covidData has fewer observations per date than we're expecting (this is after a fix to filter out zerotruth dates from Zoltar that aren't in covidData)

I'd like to dig into what we're testing here and either:

bsweger commented 8 months ago

@nickreich @elray1 The question for you all is whether or not we need to worry that the truth data as it exists in covidData doesn't match what this test is expecting.

I'm unsure of whether or not this test failure means that something is actually broken or if it simply reflects that the truth data hasn't been updated for a while.

nickreich commented 7 months ago

This was partially addressed in an internal slack thread. My feeling is that it's ok to remove the test given that we are no longer pushing truth data to zoltar, since we only were storing death and case truth data and those forecasts have been discontinued.