neulab / ExplainaBoard

Interpretable Evaluation for AI Systems
MIT License
360 stars 36 forks source link

Removes WMT DA meta-eval #606

Closed neubig closed 1 year ago

neubig commented 1 year ago

Overview

This PR removes WMT direct assessment meta-evaluation from ExplainaBoard, because there's not really any reason to treat it differently than other meta-evaluation tasks.

I have modified the final remaining meta-evaluation dataset in DataLab to work with the meta-evaluation-nlg task to make these congruent in the PR below.

Blocked by