(EAI-276): Faithfulness evaluation - Githubissues

mongodb / chatbot

MongoDB Chatbot Framework. Powered by MongoDB and Atlas Vector Search.

https://mongodb.github.io/chatbot/

Apache License 2.0

106 stars 48 forks source link

(EAI-276): Faithfulness evaluation #355

Closed mongodben closed 3 months ago

mongodben commented 4 months ago

Jira: https://jira.mongodb.org/browse/EAI-276

Changes

Add new evaluator for response faithfulness
Update the Report type to include type and name
Update the reporter to be generic for all binary-style tests

Notes