search

raspberryice / gen-arg

Code for paper "Document-Level Argument Extraction by Conditional Generation". NAACL 21'
MIT License
119 stars 30 forks source link

The event arguments annotation. #15

Closed taolusi closed 2 years ago

taolusi commented 2 years ago

Since there are coreferential entity mentions in a document, what is the principle to decide which entity mention should be annotated as the argument of an event? Besides, I find entity coreference clusters stored in split.jsonlines, but I do not find the event coreference clusters. Where are they stored?

raspberryice commented 2 years ago

Hi Qingkai, The argument annotation was done separately so the annotators did not see the coreference chains. We thought this could be a potential problem, so we recommend Coref-F1 or the informative argument F1 for better evaluation. The event coreference is not available in this version of the dataset and this information is not used by the algorithm.