aws / fmeval

Foundation Model Evaluations Library
http://aws.github.io/fmeval
Apache License 2.0
185 stars 42 forks source link

chore: restore evaluate_sample and evaluate signatures in EvalAlgorithmInterface #231

Closed danielezhu closed 6 months ago

danielezhu commented 6 months ago

Description of changes: Aside from updating the interface method signatures, this PR also makes some small updates to SummarizationAccuracy and address some comments that were left on #224.

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.