neulab / ExplainaBoard

Interpretable Evaluation for AI Systems

MIT License

361 stars 36 forks source link

Deal with the case when correlation is NaN for meta evaluation task #603

Closed pfliu-nlp closed 1 year ago

pfliu-nlp commented 1 year ago

Overview

Currently, the correlation value of the meta-evaluation task could be NaN, which will break downstream applications. This PR fix this by setting them to 0.