aws / fmeval

Foundation Model Evaluations Library
http://aws.github.io/fmeval
Apache License 2.0
153 stars 40 forks source link

feat: implement Transform and TransformPipeline classes for modular redesign #209

Closed danielezhu closed 3 months ago

danielezhu commented 3 months ago

Description of changes: This PR includes the implementation of the Transform abstract base class and the TransformPipeline class, which serve as the basis for the new evaluation algorithm design that fmeval will adopt in the next release.

The four commits included in this PR have already been reviewed as their own individual PRs (which got merged into the modular_redesign branch, as opposed to the main branch). I've realized that there isn't really a need to maintain the separate modular_redesign branch (since users who download fmeval via pip will only see the released version), so from now on, I will be submitting PRs directly to main.

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.