microsoft / rag-experiment-accelerator

The RAG Experiment Accelerator is a versatile tool designed to expedite and facilitate the process of conducting experiments and evaluations using Azure Cognitive Search and RAG pattern.
https://github.com/microsoft/rag-experiment-accelerator
Other
119 stars 41 forks source link

Add groundedness evaluation metric #573

Open kcortinas opened 1 month ago

kcortinas commented 1 month ago

We need to evaluate whether the generated answers are grounded in the retrieved contexts: ideally, we want the generated answers to include only claims inferred from the given context (no hallucinations).