`kappa` should work with string labels/predictions when unweighted

EducationalTestingService / skll

SciKit-Learn Laboratory (SKLL) makes it easy to run machine learning experiments.

http://skll.readthedocs.org

Other

551 stars 67 forks source link

`kappa` should work with string labels/predictions when unweighted #549

Closed desilinguist closed 5 years ago

desilinguist commented 5 years ago

Right now, SKLL's kappa implementation only works with string labels and predictions. There's no reason why unweighted kappas should not be computed for string categories.

desilinguist commented 5 years ago

This is actually not a bug since apps are computed with the underlying class indices rather than class labels directly.