explodinggradients / ragas

Evaluation framework for your Retrieval Augmented Generation (RAG) pipelines
https://docs.ragas.io
Apache License 2.0
6.56k stars 643 forks source link

Is it possible to add an argument to the evaluate() function to configure the group name? #967

Open zzzmc opened 4 months ago

zzzmc commented 4 months ago

Describe the Feature Add an argument to the evaluate() function to define the group name instead of using the default value "ragas evaluation".

Why is the feature important for you? When using langsmith to display evaluation results, different configurations or other situations may be used under the same project. When using the new_group() in evaluate.py, is it more flexible to pass arguments to determine the value of the argument 'name' instead of the default 'ragas evaluation'?The langsmith interface will also distinguish different results more clearly.

Additional context ragas:0.1.7 https://github.com/explodinggradients/ragas/blob/main/src/ragas/evaluation.py Original version: image image Modified version: image image

jjmachan commented 3 months ago

That is a very smart suggetion, Thank you @zzzmc, we'll add it shortly and let you know 🙂