danieldeutsch / sacrerouge

SacreROUGE is a library dedicated to the use and development of text generation evaluation metrics with an emphasis on summarization.
Apache License 2.0
134 stars 11 forks source link

[WIP] Adding FEQA implementation #78

Open danieldeutsch opened 3 years ago

danieldeutsch commented 3 years ago

The correlations on the QAGS dataset are near 0, so there is likely some error (either here or with the QAGS data). I do not know what yet.