-
Hello again :) I have an issue with how the relevancy scores are computed for some LLaMA models for sequence classification.
I have a classification task that I am using in the following screensho…
-
I encountered an issue while evaluating a dataset using the ragas library with the Langchain LLM and Sentence Transformer embeddings. The process throws an exception during execution.
**Steps to Repr…
-
### Question Validation
- [X] I have searched both the documentation and discord for an answer.
### Question
Hi, I have a `LabelledRagDataset` created with `RagDatasetGenerator`. Now how can …
-
**Describe the bug**
A clear and concise description of what the bug is.
I tried using RAGAS with a model that is not OpenAI. In general whatever model I use I get this error back:
```
File …
-
I have down model weights in my computer，but i don't how to use LOCAL LLMS and Embeddings for ragas according to
Here is My code but it did't work
```
import typing as t
import asyncio
from ty…
-
[ *] I checked the [documentation](https://docs.ragas.io/) and related resources and couldn't find an answer to my question.
**Your Question**
what is unclear to you? What would you like to know?
…
-
[ ] I have checked the [documentation](https://docs.ragas.io/) and related resources and couldn't resolve my bug.
**Describe the bug**
I cannot evaluate open source gemma:2b model using ragas. I…
-
The examples given in metrics is for classification and not regression. Any example to implement faithfulness and monotonicity on regression?
-
Hi, thanks for your awesome work.
I would like to know whether your paper has been accepted? I will cite it in my work.
edzq updated
2 months ago
-
Large language models (LLMs) encode parametric knowledge about world facts and have shown remarkable performance in knowledge-driven NLP tasks. However, their reliance on parametric knowledge may caus…