-
[ ] I have checked the [documentation](https://docs.ragas.io/) and related resources and couldn't resolve my bug.
**Describe the bug**
KeyboardInterrupt: Exception raised in Job[1]: TypeError(unsu…
-
#My code is
from datasets import Dataset
from ragas.llms import LangchainLLMWrapper
from langchain_community.embeddings import SparkLLMTextEmbeddings, HuggingFaceEmbeddings
#from langchain_commu…
-
Hi! I am wondering if it's possible to use open source or self-deployed llms (and not only open ai) as the judge or evaluator? If yes, could you please refer to an example or part of the docs explaini…
-
Opening statement summary
Overall your paper don't seem to be finished.
Strong positive points
I see you have changed the Rproj name and I can tell what you're trying to do in your paper.
…
-
### Question Validation
- [X] I have searched both the documentation and discord for an answer.
### Question
I want to evaluate the precision and recall of my RAG Application build on llama index.I…
-
Here is my code:
```
import typing as t
import asyncio
from typing import List
from datasets import load_dataset, load_from_disk
from ragas.metrics import faithfulness, context_recall, context_p…
-
- This issue focuses on the technical courses we take about LLM, we'll put the paper part in
https://github.com/xp1632/DFKI_working_log/issues/70
---
1. **ChainForge** https://chainforge.ai/ …
-
My code:
```
import typing as t
import asyncio
from typing import List
from datasets import load_dataset, load_from_disk
from ragas.metrics import faithfulness, context_recall, context_precisi…
-
Not sure if this feature belongs to this library or would it require a complete separate library. I am proposing the creation of a library where llm benchmarks can be ran. For example, evaluating a mo…
-
[ ] I have checked the [documentation](https://docs.ragas.io/) and related resources and couldn't resolve my bug.
Hi experts,
I use the answer_correctness as the metric, but it failed due to **A…