search

vanderschaarlab / autoprognosis

A system for automating the design of predictive modeling pipelines tailored for clinical prognosis.
https://www.autoprognosis.vanderschaar-lab.com/
Apache License 2.0
95 stars 26 forks source link

Classification with explainers #57

Closed marthajoddrell closed 1 year ago

marthajoddrell commented 1 year ago

Is there a reason that 'aucroc' and 'aucprc' are the only metrics available for evaluate_estimator()?

bcebere commented 1 year ago

Hello @marthajoddrell

Thank you for your question!

These are two of the more popular metrics for benchmarking classifiers, with no other particular reason.

Let us know if you want support for some other metrics, and we will try to include them in a future release.

Thanks!

marthajoddrell commented 1 year ago

Thank you for the response!

It would be helpful to have other popular metrics such as the actual sensitivity, specificity, etc and possibly also the confusion matrix. The clinical application we are exploring involves basic programming knowledge so it would be helpful if a detailed performance was easy available in the results.

bcebere commented 1 year ago

Hello @marthajoddrell

Thank you for the feedback.

We will work and add the metrics you mentioned in the next release.