Closed alexitkes closed 4 years ago
Note that I can try to fix it myself, I think I know how it happens.
This would be great. Otherwise, please let us know what you think is going wrong.
It's looking like score function is passing the predicted class vector to roc_auc scorer while it needs the probability matrix. I thought it could be fixed by setting needs_proba
flag for roc_auc metric
https://github.com/alexitkes/auto-sklearn/blob/880eff289b40473bca4d23caa8c143c87505583d/autosklearn/metrics/__init__.py#L214
But it dit not work - now there are more errors while fitting.
Fixed via #879. Please reopen if this issue still persists with the development branch.
Describe the bug
AutoSklearnClassifier crashes when trying to get its score if metric is set to roc_auc
To Reproduce
Expected behavior
It should display two numbers, just like for accuracy scoring
Environment and installation:
Ubuntu 18.04.4 Python 3.6.9 Auto-Sklearn 0.7.0
Note that I can try to fix it myself, I think I know how it happens.