h2oai / h2o-3

H2O is an Open Source, Distributed, Fast & Scalable Machine Learning Platform: Deep Learning, Gradient Boosting (GBM) & XGBoost, Random Forest, Generalized Linear Modeling (GLM with Elastic Net), K-Means, PCA, Generalized Additive Models (GAM), RuleFit, Support Vector Machine (SVM), Stacked Ensembles, Automatic Machine Learning (AutoML), etc.
http://h2o.ai
Apache License 2.0
6.92k stars 2k forks source link

Add multiclass AUC #10037

Open exalate-issue-sync[bot] opened 1 year ago

exalate-issue-sync[bot] commented 1 year ago

H2O reports AUC for binomial models, and this is likely the most common assessment tool for classification problems. But the multinomial case is not as straightforward, and H2O does not report or calculate it. Having this available in the scoring history (and Flow) would be very helpful for users accustomed to seeing AUC.

The pROC package in R implements it and also mlr.

h2o-ops commented 1 year ago

JIRA Issue Migration Info

Jira Issue: PUBDEV-3114 Assignee: New H2O Bugs Reporter: Mark Landry State: Open Fix Version: N/A Attachments: N/A Development PRs: N/A