openai / openai-cookbook

Examples and guides for using the OpenAI API
https://cookbook.openai.com
MIT License
57.47k stars 9.07k forks source link

RAG evaluation with RAGAs using GPT4o #1233

Open PrashantDixit0 opened 1 month ago

PrashantDixit0 commented 1 month ago

Summary

RAG Evaluation notebook with RAGAs using GPT-4o for easy to evaluate RAG and evaluate it on various metrics.

Motivation

Already existing notebooks doesn't provide all the metrics like context and answer relevancy, faithfulness and many other which is very important to evaluate any RAG application.


For new content

When contributing new content, read through our contribution guidelines, and mark the following action items as completed:

We will rate each of these areas on a scale from 1 to 4, and will only accept contributions that score 3 or higher on all areas. Refer to our contribution guidelines for more details.

PrashantDixit0 commented 1 month ago

@ted-at-openai @simonpfish, Please add this Notebook it would be great to have notebooks providing metrics for evaluation

Faisal1809 commented 1 week ago

add u comment in my apps , while u read now and write