aws / fmeval

Foundation Model Evaluations Library
http://aws.github.io/fmeval
Apache License 2.0
155 stars 40 forks source link

Strip text when computing precision and recall. #172

Closed bilalaws closed 5 months ago

bilalaws commented 5 months ago

Description of changes: Prior to this PR, we strip the text when computing f1_score but not when computing precision and recall. This PR makes the stripping functionality uniform across all three metrics.

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.