Probabilities

[danielemolino]

Hi, I was thinking if it is somehow possible to extract the probabilities of the classification, to then evaluate the AUROC

[jirvin16]

This is a rule-based labeler so it does not support outputting classification probabilities.

[danielemolino]

Thanks! It is exactly what I wanted to hear. Because I read some works where someone was computing AUROC on the prediction obtained by the labeler, and I was trying to understand how was that possible.

Do you confirm me that this doesn't make much sense, and it is like evaluating the accuracy of the model?

[jirvin16]

Not sure what works you're referring to, but this work for example does produce classification probabilities!