-
- **Package Name**: azure-ai-generative
- **Package Version**: 1.0.0b2
- **Operating System**: Mac M1
- **Python Version**: 3.11
**Describe the bug**
When calling evaluate(), we see this in t…
-
### What is the issue?
The quality of the results returned by the embedding model now is much worse than the previous version.
### OS
Linux
### GPU
Nvidia
### CPU
Intel
### Ollama version
0.1…
-
### Question Validation
- [X] I have searched both the documentation and discord for an answer.
### Question
Hi, I have a `LabelledRagDataset` created with `RagDatasetGenerator`. Now how can …
-
[x] I checked the [documentation](https://docs.ragas.io/) and related resources and couldn't find an answer to my question.
**Your Question**
Hello, ragas Team!
I am very impressed to see that th…
-
## Evaluation metrics
1. Embeddings
1.1 Question ID = 1 (6,231 questions)
| Model | Question ID | Correct matches | Accuracy (%) |
| -------- | ------- | -------- | ------- |
| Mixtra…
-
- [x] The first time user opens the app, drop a hint to create a new use case or iteration via **Use Cases+** CTA.
- [x] For a new iteration (blank state), drop a hint to start adding nodes via **Add …
-
This task involves automating the current 'precheck' stage which currently involves a human 'triage-er' to validate whether the student model already knows the information which a user is trying to te…
-
### Bug Description
I was following the cookbook (https://github.com/stanfordnlp/dspy/blob/main/examples/llamaindex/dspy_llamaindex_rag.ipynb) but changed the LLM and embeddings model to non-OpenAI m…
-
Hello, thanks for your amazing work!
I want to ask questions about an error `KeyError: 'original_splitted_sentences'` that I encountered when trying to generate results for FactScore.
## Error
…
-
How can we add custom questions and ground truth to the testset generated using Ragas TestSetGenerator:
```
from ragas.testset.generator import TestsetGenerator
from ragas.testset.evolutions impo…