danieldeutsch / sacrerouge

SacreROUGE is a library dedicated to the use and development of text generation evaluation metrics with an emphasis on summarization.
Apache License 2.0
134 stars 11 forks source link

[WIP] QAGS #77

Open danieldeutsch opened 3 years ago

danieldeutsch commented 3 years ago

Adds a wrapper around the QAGS metric. The correlations currently do not reproduce the paper's results and the scores are non-deterministic.