search

raspberryice / gen-arg

Code for paper "Document-Level Argument Extraction by Conditional Generation". NAACL 21'
MIT License
115 stars 29 forks source link

Where is the WikiEvents dataset #11

Closed KyrieIrving24 closed 2 years ago

raspberryice commented 2 years ago

Hi, I've updated the README file to include more detailed instructions.

KyrieIrving24 commented 2 years ago

Hi, I've updated the README file to include more detailed instructions.

Thank you for your reply，and i have question about the metric。 I dont understand the Coref F1. In the paper，it may mean the offsets match the reference，but in your code，it is equal to informative argument. Looking forward to your reply！

raspberryice commented 2 years ago

The Head F1 metric means that the extracted span's offset matches the reference offset. The Coref F1 metric checks if the extracted span's offset matches any of the coreferential spans of the reference mention. In the code there's a mapping table from every mention -> its information mention. If the extracted span and the reference span map to the same thing under this table, it means that there are coreferential. (In this case, the extracted span and the reference span do not need to be the information mention.)

For the informative argument extraction, the difference is in the training. During training, only the informative argument span is treated as the ground truth. The Head F1 in this case is checking whether the extracted span's offset matches the informative span offset.