search

GEM-benchmark / GEM-metrics

Automatic metrics for GEM tasks
https://gem-benchmark.com
MIT License
60 stars 20 forks source link

Additional diversity metrics #24

Open evanmiltenburg opened 3 years ago

evanmiltenburg commented 3 years ago

A number of diversity metrics is implemented here, for this EACL2021 paper. We could port them to GEM.

vyraun commented 2 years ago

@evanmiltenburg @sebastianGehrmann I can pick this up. Will make a PR soon targeting GEM v2, if that's okay.

vyraun commented 2 years ago

@evanmiltenburg @sebastianGehrmann Just raised a PR to integrate two diversity metrics at https://github.com/GEM-benchmark/GEM-metrics/pull/86. Thanks.