openml / OpenML

Open Machine Learning
https://openml.org
BSD 3-Clause "New" or "Revised" License
664 stars 90 forks source link

Add G-mean as an evaluation metric #872

Open AndriyMulyar opened 5 years ago

AndriyMulyar commented 5 years ago

Add the geometric mean (g_mean) of precision and recall as an evaluation metric for classification. Geometric Mean

joaquinvanschoren commented 5 years ago

Is that different from the harmonic mean? We call that the f_measure: https://www.openml.org/a/evaluation-measures/f-measure

Hmm, I guess it is a bit different. You can add new evaluation metrics to OpenML by adding a new evaluation engine, yet this is not very well documented at the moment.

AndriyMulyar commented 5 years ago

Yes. Here is a nice paper with discussion: Kubat,1997 for anyone who may come across this issue in the future.