confident-ai / deepeval

The LLM Evaluation Framework
https://docs.confident-ai.com/
Apache License 2.0
3.68k stars 292 forks source link

[Question] What's the difference between Deepeval's RAG Evaluation and RAGAS #1015

Closed landhu closed 1 month ago

landhu commented 2 months ago

Deepeval have rag evaluation https://docs.confident-ai.com/docs/guides-rag-evaluation And another repo can do rag evaluation: https://github.com/explodinggradients/ragas

What's the difference between the two in rag evaluation?

penguine-ip commented 1 month ago

@landhu similar implementation, more support into deepeval's ecosystem (concurrent execution, caching, verbose logs for debugging, integrate into Confident AI, etc)