probml / pml2-book

Probabilistic Machine Learning: Advanced Topics
MIT License
1.39k stars 119 forks source link

Brier Score definition should be negated #241

Closed chrisyeh96 closed 1 year ago

chrisyeh96 commented 1 year ago

Book version: 2023-04-01

Issue: The Brier score (equation 14.16) is not a proper scoring rule as written. It needs a negative sign in front.

More details: Equation 14.16 is equivalent to the score function defined in Brier's original paper. However, Brier's paper defined the score function such that lower scores are better. In contrast, in the modern definition of proper scoring rules (including this book's own definition), larger scores are better. Hence, Equation 14.16 needs a negative sign in front.

murphyk commented 1 year ago

good catch. Fixed.