Delexicalized Test Set - Githubissues

ThiagoCF05 / webnlg

The enriched version of the WebNLG described at INLG 2018

69 stars 22 forks source link

Delexicalized Test Set #2

Closed AmitMY closed 5 years ago

AmitMY commented 5 years ago

The full test set including references was released a few months ago. I think it would be beneficial for completeness sake to also delexicalize that data. Reasoning:

It is a better test set for testing referring expressions - for both seen and unseen entities.
For systems who decouple the referring expressions generation from the sentence realization phase, this will make testing parts of systems simpler.

ThiagoCF05 commented 5 years ago

We are finishing the review of our annotation for train and development sets. Then we are going to start to annotate the test set. You may expect it for February 2019.

AmitMY commented 5 years ago

Thank you, those are great news!

AmitMY commented 5 years ago

Thanks for completing this!

ThiagoCF05 commented 5 years ago

Dear @AmitMY ,

As promised, the annotation of the test part of the data is already available. I am closing the issue here.

Best,