feat: add summary to LLM output in evaluation - Githubissues

FullFact / health-misinfo-shared

Raphael health misinformation project, shared by Full Fact and Google

MIT License

0 stars 0 forks source link

feat: add summary to LLM output in evaluation #155

Closed c-j-johnston closed 1 month ago

c-j-johnston commented 2 months ago

Fixes #154.

Updates broken promptfoo evaluation to support summary scoring with new functions, now that the LLM does not return summaries.

Pull request checklist

[x] I have linked my PR to an issue
[x] I’ve used conventional commits
[x] My branch is up-to-date with main
[ ] Where appropriate, I have added or updated tests
[ ] Where appropriate, I have updated documentation to reflect my changes