aws-samples / amazon-bedrock-samples

This repository contains examples for customers to get started using the Amazon Bedrock Service. This contains examples for all available foundational models
https://aws.amazon.com/bedrock/
MIT No Attribution
439 stars 232 forks source link

RAG evaluation using RAGAS #70

Closed ayanray089 closed 7 months ago

ayanray089 commented 7 months ago

Issue #, if available:

Description of changes: RAG Evaluation using RAGAS. Evaluating metrics - faithfulness, answer_relevancy, context_precision, context_recall. The evaluation is performed on a set of questions and ground truths and the output is visualized using a pandas dataframe.

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

mani-aiml commented 7 months ago

Feedback provided, author will use the new branch.