-
Thank you for great work!
As you said, it need to remove duplicate documents in KP20k. Can i know source code or methods how to check same document between KP20k and test sets?
>We also found ou…
-
**Describe the bug**
Can't get the automatic language adaption going for testset generation. I retried this about 10 times.
Ragas version: 0.1.4
Python version: 3.11
**Code to Reproduce**
Sha…
-
I've create two LUKS partitions (with defaults) 20Gb both under Ubuntu 15.04: first on internal SSD with GPT, second on external HDD with MBR.
#1. EE: Unable to open container.
**Please check your ke…
-
- [x] I have checked the [documentation](https://docs.ragas.io/) and related resources and couldn't resolve my bug.
**Describe the bug**
While looking for the answer to the issue #1138, I've notic…
-
Is there a specific reason these decisions were made about the testset setup and is there a way to influence number of chunks retrieved and chunk overlap in the code below:
@classmethod
d…
-
Testing it with a single small document splitter in 5 chuncks. Repeating the test with 2 documents. To see if that could be the issue. This could be related to issue below but I am not using adaptor. …
-
**Description, Use Case and User Stories**
From: Connor Mullaly 8/12/2024 possibility for the model to return hints when the inputs are using impact-oriented, attack-oriented, or mitigation-oriented …
-
[ /] I have checked the [documentation](https://docs.ragas.io/) and related resources and couldn't resolve my bug.
**Describe the bug**
I'm currently trying to use HuggingFace LLMs and embedding m…
-
I am trying to generate syntetic data using Azure Open AI in a simple case:
```
test_dataset = generator.generate_with_langchain_docs(
documents, test_size=1, with_debugging_logs=True…
-
Hello,
I've been exploring the methodology for calculating answer relevancy and noticed that the context is provided alongside the answer during the evaluation process.
As I understand it, the …