epiforecasts / simplified-forecaster-evaluation

Evaluation of a simplified forecasting model designed to emulate the performance of the ECDC forecasting hub.
https://epiforecasts.io/simplified-forecaster-evaluation/paper.pdf
MIT License
4 stars 0 forks source link

Improve discussion of calibration #13

Closed seabbs closed 1 year ago

seabbs commented 1 year ago

What do we consider good / relatively good / poor performance in terms of calibration? Discussion should in general be quantified.

See the following resources from @sbfnk:

seabbs commented 1 year ago

In https://github.com/epiforecasts/simplified-forecaster-evaluation/commit/80001790a93cba64fb42a496dbff05a9ef051e6b I added some explicit values to the text for overall coverage and modified some of the language used.

sbfnk commented 1 year ago

I think this is much improved in the new version.

seabbs commented 1 year ago

Closing for now but happy to add based on the next comment round.