Add citation_match metric, changed argument, answer reviewer - Githubissues

Azure-Samples / ai-rag-chat-evaluator

Tools for evaluation of RAG Chat Apps using Azure AI Evaluate SDK and OpenAI

MIT License

162 stars 58 forks source link

Add citation_match metric, changed argument, answer reviewer #57

Closed pamelafox closed 3 months ago

pamelafox commented 3 months ago

Purpose

New changed for the diff tool to filter by only answers where a metric changed
New citation_match metric to see if an answer has same citations as ground truth
Experimental answer viewing webpage

Does this introduce a breaking change?

[ ] Yes
[X] No

Pull Request Type

What kind of change does this Pull Request introduce?

[ ] Bugfix
[X] Feature
[ ] Code style update (formatting, local variables)
[ ] Refactoring (no functional changes, no api changes)
[ ] Documentation content changes
[ ] Other... Please describe:

How to Test

pytest