-
[X ] I have checked the [documentation](https://docs.ragas.io/) and related resources and couldn't resolve my bug.
**Describe the bug**
I am trying to follow [this](https://docs.ragas.io/en/stable…
-
**Describe the bug**
I want to use local llms to evaluate my rag app, I have tried Ollama and HuggingFace models but neither of them is working.
Ragas version: 0.1.11
Python version: 3.11.3
**…
-
Some of Cabal's defaults for fields are not great for ergonomics and boilerplate reduction. In #112 I suggested setting our default `default-language` to `Haskell2010`, which is what about 99.5% of co…
-
It could be clearer how to use the evaluators that use "context" in addition to input and output in the `Eval` run, such as `Faithfulness` and `ContextRelevancy`.
Right now, I'm including contexts …
-
When I create an evaluation dataset using EvaluationDataset and I use it with LLMTestCase, I get this:
```
File "/Users/abhijeet.pise/miniconda3/envs/evaluation/lib/python3.12/site-packages/deep…
-
### Description of the problem
- Support tabular data for different categories of explanation quality such as Robustness, Faithfulness
- Lay out the technical requirements of the different categori…
-
Rephrase FCI and similar checkbox arguments to avoid the "Yes if " construct.
Instead of "Yes if (one edge) faithfulness should be assumed", just use
"Assume (one edge) faithfulness?" ...etc.
…
-
`[[Maschil of Ethan the Ezrahite.]]` is missing from Psalm 89:1 in the t_kjv.xml
Psalm 89:1
[[Maschil of Ethan the Ezrahite.]] I will sing of the mercies of the LORD for ever: with my mouth will I…
-
[ ]Hello I have checked the [documentation](https://docs.ragas.io/) and related resources and couldn't resolve my bug.
**Describe the bug**
Hello, when I run a sample like this with chinese:
from…
-
[ x] I have checked the [documentation](https://docs.ragas.io/) and related resources and couldn't resolve my bug.
**Describe the bug**
Faithfullness is not working returning always Nan, sometimes…