THU-KEG / MAVEN-ERE

Source code and dataset for EMNLP 2022 paper "MAVEN-ERE: A Unified Large-scale Dataset for Event Coreference, Temporal, Causal, and Subevent Relation Extraction".
GNU General Public License v3.0
77 stars 8 forks source link

Unable to find the gold annotations for test set #4

Closed nurakib closed 1 year ago

nurakib commented 1 year ago

I downloaded the dataset from google drive, and the test split has no relations mentioned in the test jsonlines file (train and validation set do have it). Where do I find the gold event-to-event relations?

Bakser commented 1 year ago

Hi, we decided to keep the test set annotation undisclosed to maintain a fair and consistent evaluation environment. If you want to get the results on the test set, you can submit your predictions to CodaLab following the instructions in README.