-
I have down model weights in my computer,but i don't how to use LOCAL LLMS and Embeddings for ragas according to
Here is My code but it did't work
```
import typing as t
import asyncio
from ty…
-
Dear Authors,
Firstly, I would like to commend you on your outstanding work. I am currently exploring the baseline methods LAMOL-m and VQG discussed in your paper and have a few questions that I ho…
-
#### Reason/Context
Please try answering few of those questions
- Why we need this improvement?
To not lose information (from a documention perspective) in the process of generating C# models
- Ho…
-
I am currently using Ragas to evaluate my RAG application, which is built using llama index . I've encountered a few issues in the generated results:
1- When generating queries using `TestsetGenera…
-
# Bug Overview
I've noticed a couple of issues in the quiz function that could potentially hinder the user experience:
1. Inconsistent Language: The quiz questions and instructions are presented i…
-
ScienceQA was evaluated in your experiments. As I understand, ScienceQA is a benchmark associated with multi-modal tasks, whereas your model operates purely within the realm of text. Could you please …
-
I am using [this](https://colab.research.google.com/github/patil-suraj/exploring-T5/blob/master/T5_on_TPU.ipynb) notebook to train model
I have following dataset which is different from SQUAD used i…
-
### Checked other resources
- [X] I added a very descriptive title to this issue.
- [X] I searched the LangChain documentation with the integrated search.
- [X] I used the GitHub search to find a sim…
-
Hey,
I was wondering if you think it would be possible to create a synthetic dataset for function calling tasks?
I would like to use that dataset for a finetuning experiment.
Thanks for any guida…
-
in 📚Knowledge and Capability Evaluation -> Question Answering
RAGAS: Automated Evaluation of Retrieval Augmented Generation
[paper](https://arxiv.org/abs/2309.15217)
[RAGAS framework on github]…