Can separate the entity_label evaluation results?

ShannonAI / mrc-for-flat-nested-ner

Code for ACL 2020 paper `A Unified MRC Framework for Named Entity Recognition`

643 stars 117 forks source link

Can separate the entity_label evaluation results? #55

Open minstar opened 3 years ago

minstar commented 3 years ago

there are various labels (e.g., "ORG", "LOC", "MISC" etc.). Is there any way to evaluate separately? evaluate.py always shows overall results I think.

YuxianMeng commented 3 years ago

@minstar evaluate.py actually run self.validation_step defined in trainer.py. I recommend to read pytorch-lightning documents to learn more about its mechanism and implement your own metrics