-
I want to evaluate a single completion of my LLM.
Code:
```python
from ragas import evaluate
from datasets import Dataset
import os
# prepare your huggingface dataset in the format
# Datase…
-
Trying to piece together a basic evaluation example from the docs with a locally-hosted LLM through langchain textgeninference but running into problems in evaluate(). Where am I going wrong?
```
…
-
I was going through docs and noticed a few typos. Sharing them here.
[Evaluation Document](https://github.com/explodinggradients/ragas/blob/main/docs/getstarted/evaluation.md?plain=1#L31-L34):
> q…
-
### Feature description
While our `ragna.core.Source` object stores the source content
https://github.com/Quansight/ragna/blob/7b176528c7524edc8bcf8754695caa5a363a8e23/ragna/core/_components.py#L…
-
### How are you running AnythingLLM?
AnythingLLM desktop app
### What happened?
When running RAG for a pdf document in windows 11 all the contexts are shown before answering the prompt but not in w…
-
**Is your feature request related to a problem? Please describe.**
If we need test in batch run promptflow pipeline in chat with multiple conversations between user and assistant, for now we only can…
-
Hi @drazvan,
I am using check_facts action from the repo on top of my RAG use case. Although the answer returned by the llm is correct, the check_facts action says that the response does not entail…
-
I just watched your excellent training done in partnership with LlamaIndex: https://learn.deeplearning.ai/building-evaluating-advanced-rag
I was wondering how add the RAG Triad metrics to my LangCh…
-
Below are the outputs I get when using different settings... had trouble for over a week, seemed to work for a short period a few days ago, but definitely not working that last couple of days...
Ch…
-
Hello,
I want to use Ragas to evaluate my RAG model. I am not using (and don't want to use) OpenAI but models that are running locally on my laptop (Llama 2 variations). So I got to this page of th…