feat: implement transforms for summarization accuracy metrics

aws / fmeval

Foundation Model Evaluations Library

http://aws.github.io/fmeval

Apache License 2.0

153 stars 40 forks source link

feat: implement transforms for summarization accuracy metrics #211

Closed danielezhu closed 3 months ago

danielezhu commented 3 months ago

Description of changes: This PR implements Transforms for the three existing summarization accuracy metrics supported by fmeval: Meteor, Rouge, and Bert.

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.