neulab / ExplainaBoard

Interpretable Evaluation for AI Systems
MIT License
359 stars 36 forks source link

Add temporary fix to MetaEvalNLGCITest to fix flakiness #550

Closed tetsuok closed 1 year ago

tetsuok commented 1 year ago

This PR adds a workaround to fix the flakiness of MetaEvalNLGCITest as discussed in #537. The code change is cherry-picked from #532 (including suggestions by @neubig) because other pull requests get affected by the flakiness and because #532 is still in review.

tetsuok commented 1 year ago

@pfliu-nlp Thanks for merging!