Closed chmeyer closed 9 years ago
If only one annotation item and one category is present, the expected agreement is 1
(since there is only one category, the two raters basically have no choice at all.
Thus, Cohen's kappa calculates to:
kappa = (A_O - A_E) / (1 - A_E) = (1 - 1) / (1 - 1) = 0 / 0 = NaN
Returning 1 in this case would be misleading IMHO.
(BTW: sorry for late response, e-mail notification was turned off :-/).
Reported by chmeyer.de
on 2014-07-25 13:51:14
WontFix
Originally reported on Google Code with ID 1
Reported by
roland.kluge.de
on 2013-12-06 10:06:26