search

aws / fmeval

Foundation Model Evaluations Library
http://aws.github.io/fmeval
Apache License 2.0
151 stars 40 forks source link

feat: faithfulness handle no statements edge case #298

Closed xiaoyi-cheng closed 5 days ago

xiaoyi-cheng commented 6 days ago

Issue #, if available: Handle edge case when no statements being generated from judge model.

Description of changes:

  1. Rebased from https://github.com/aws/fmeval/pull/297.
  2. Generate error in EvalScore if no statements

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.