aws / fmeval

Foundation Model Evaluations Library
http://aws.github.io/fmeval
Apache License 2.0
185 stars 42 forks source link

feat: implement GeneratePrompt and GetModelResponse utility transforms #201

Closed danielezhu closed 7 months ago

danielezhu commented 7 months ago

Description of changes: This PR implements two utility transforms: one for generating prompts from raw text input, and another for invoking model runners. It also implements a few validation utility functions that will be used across all Transforms that we implement.

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.