aws / fmeval

Foundation Model Evaluations Library
http://aws.github.io/fmeval
Apache License 2.0
151 stars 40 forks source link

feat: add error field in EvalScore #297

Closed xiaoyi-cheng closed 5 days ago

xiaoyi-cheng commented 6 days ago

Issue #, if available: Add error fields in EvalScore. Ignore None value when aggregate dataset score.

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.