search

andybega / auc-pr

Code for precision-recall curves
9 stars 2 forks source link

Area under Precisio-Recall Curve for multi-class problems #1

Open ogreyesp opened 7 years ago

ogreyesp commented 7 years ago

Hello,

Is there a way to compute the Area Under the Precision-Recall Curve for multi-class problems with this library?

Thanks

andybega commented 7 years ago

Hi, there is no built-in support for multi-class inputs.

There is a multiclass.roc in the pROC library that plots multiple ROC curves for multi-class problems and computes the AUC-ROC as the mean of all the one-vs-all AUC-ROCs for each class. You could do something like that manually here by constructing the one-vs-all vectors for each class beforehand, but that's about it.

I'll try to work on this at some point but can't right now because of day job.