-
For example:
```
gsutil ls gs://moz-fx-translations-data--303e-prod-translations-data/models/lt-en/opustrainer_no_student_aug_K1iHndFUSxSEDRLg_H9l1A/evaluation/student
```
shows
```
gs://m…
-
### Question Validation
- [X] I have searched both the documentation and discord for an answer.
### Question
I want to evaluate the precision and recall of my RAG Application build on llama index.I…
-
**### Title: Model Evaluation and Comparison for Loan Prediction**
**Description:**
This issue pertains to the implementation and evaluation of various machine learning models for predicting loa…
-
Evaluation failed: 'CustomOllama' object has no attribute 'set_run_config', what is the solution,
Ragas Version: 0.1.7
**Code Examples**
# Define a simple dataset using Pandas DataFrame
data…
-
## Describe the bug
1. Add `**kwargs` to allow formatted_doc to be passed into metric computation to address the following
```
metrics = compute_metric(results=sample_responses, formatted_doc=d…
-
Dear Author
First of all, thank you for providing me the new branch of the trained model. After that I tried to train the model on the basis of consistent parameters, the cross-validation results wer…
-
> Please provide us with the following information:
> ---------------------------------------------------------------
### This issue is for a: (mark with an `x`)
```
- [x] bug report -> please…
-
[X] I checked the [documentation](https://docs.ragas.io/) and related resources and couldn't find an answer to my question.
**Your Question**
what is unclear to you? What would you like to know?
…
-
Hello! I have already trained the DCFormer on the Pile dataset, and now I would like to evaluate it on downstream tasks. I noticed that the Lambada evaluation set is mentioned in your paper, and it se…
-
[ ] I checked the [documentation](https://docs.ragas.io/) and related resources and couldn't find an answer to my question.
**Your Question**
How to calculate total tokens consumption for evaluati…