aws / fmeval

Foundation Model Evaluations Library
http://aws.github.io/fmeval
Apache License 2.0
214 stars 46 forks source link

chore: rename factual knowledge scores #312

Closed danielezhu closed 4 months ago

danielezhu commented 4 months ago

Issue #, if available:

Description of changes: This PR updates the names of the factual knowledge scores such that the changes to the factual knowledge algorithm from #302 are not breaking changes. Currently, we are removing the FACTUAL_KNOWLEDGE constant from the factual_knowledge module and renaming the scores that get output by the algorithm. These are incompatible API changes, and according to semantic versioning, this would require us to bump the major version when performing the next release.

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.