PlusLabNLP / X-Gear

Code for our ACL-2022 paper "Multilingual Generative Language Models for Zero-Shot Cross-Lingual Event Argument Extraction".
19 stars 7 forks source link

the classification f1 about en to ar #3

Closed mahuipeng98 closed 2 years ago

mahuipeng98 commented 2 years ago

In your paper(Multilingual Generative Language Models for Zero-Shot Cross-Lingual Event Argument Extraction), the classification f1 about en to ar is 44.8(mT5-large). But in github readme.md, the classification f1 about en to ar is 50.00(mT5-large). Why?

ihungalexhsu commented 2 years ago

Hi, I think this is because the paper's result is the average score across many random seeds. The model we put is the best model we have.

mahuipeng98 commented 2 years ago

Thank you for your reply. Best wishes.