Closed Bisaloo closed 3 years ago
This can go - the forecast reports have the same filter here but I think the csv files can contain all models, including ones that have not been submitted recently: https://github.com/epiforecasts/covid19-forecast-hub-europe/blob/49d65f25dbcbbb7807362695cfa6f1204c03f8c2/code/reports/rmdchunks/ranking-table.Rmd#L41
Also the continuous_weeks
column that's created here is used to create the weighted ensemble only from models that have been submitted for X weeks in a row.
https://github.com/epiforecasts/covid19-forecast-hub-europe/blob/49d65f25dbcbbb7807362695cfa6f1204c03f8c2/code/ensemble/methods/create-ensemble-relative-skill.R#L65
https://github.com/epiforecasts/covid19-forecast-hub-europe/blob/49d65f25dbcbbb7807362695cfa6f1204c03f8c2/code/evaluation/score_models.r#L17
@sbfnk, is this on purpose? Or should it be there with the function described in the following comment?
https://github.com/epiforecasts/covid19-forecast-hub-europe/blob/49d65f25dbcbbb7807362695cfa6f1204c03f8c2/code/evaluation/score_models.r#L12