mlcommons / GaNDLF

A generalizable application framework for segmentation, regression, and classification using PyTorch
https://gandlf.org
Apache License 2.0
158 stars 79 forks source link

Fix binary auroc error #914

Closed VukW closed 1 month ago

VukW commented 1 month ago

For binary classification, AUROC metric requires a proba just of the class 1, with shape of (N,) rather then (N,C) as for multiclass. https://lightning.ai/docs/torchmetrics/stable/classification/auroc.html#binaryauroc So, right now binary classification AUROCmetric should fail (at least, it always fails for me). We may check why CI tests work as expected btw...

Checklist

github-actions[bot] commented 1 month ago

MLCommons CLA bot All contributors have signed the MLCommons CLA ✍️ ✅