Babelscape / rebel

REBEL is a seq2seq model that simplifies Relation Extraction (EMNLP 2021).
502 stars 73 forks source link

Evaluation details of REBEL on DocRED #74

Open gxxxzhang opened 9 months ago

gxxxzhang commented 9 months ago

Hi @LittlePea13, I have a question about the details of the experimental evaluation on DocRED. For Docred, the dataset includes 96 relation classes and class of 'no_relation'. So, I want to know if the micro-f1 includes the class of 'no_relation'. Or, similar to other works which entities and their mentions are both assumed to be given, the evaluation only conducted in the 96 positive relation classes.