search

allenai / allennlp

An open-source NLP research library, built on PyTorch.
http://www.allennlp.org
Apache License 2.0
11.73k stars 2.24k forks source link

AUC for Multi-label Multi-class classification task #2883

Open rvj07ai opened 5 years ago

rvj07ai commented 5 years ago

I am looking forward to have AUC for multi-label multi-class classification task but the AllenNLP library currently does not support it

Has anyone tried it earlier ?

joelgrus commented 5 years ago

we have AUC for binary classification

https://github.com/allenai/allennlp/blob/master/allennlp/training/metrics/auc.py

but I don't know of anyone who's implemented it for multi-label / multi-class classification, sorry.

rvj07ai commented 5 years ago

Thanks @joelgrus - I have tried reusing the auc mentioned above to implement a custom multi-label / multi-class classification AUC . Working on it..

mukhal commented 5 years ago

@rvj07ai Are you still working on this feature? I'm thinking of starting on it.