-
## Why RAG
Retrieval-Augmented Generation (RAG) is a technique that enhances the capabilities of LLMs by incorporating a retrieval mechanism into the generative process. This approach allows the model…
-
### Question Validation
- [X] I have searched both the documentation and discord for an answer.
### Question
Hi, I have a `LabelledRagDataset` created with `RagDatasetGenerator`. Now how can …
-
Currently, users of `deepeval` can only create their own evaluation dataset/test cases. To support more users fine-tuning their model, `deepeval` should be able to import standard benchmarks such as M…
-
Thanks for your inspiring work @AkariAsai .
I tried to run the `script_finetune_7b.sh` script myself (using meta-llama/Llama-2-7b-hf and your provided generator data), which is expected to produce …
-
When attempting to train an LLM judge I get the following error.
```
---------------------------------------------------------------------------
RuntimeError Tracebac…
WJ44 updated
2 months ago
-
Greetings,
This was not entirely apparent to me, but which metric is used to report the results of models on TruthfulQA on the HuggingFace open-source leaderboard here https://huggingface.co/spaces…
-
## Overview
- We need your help to deploy a large language model on NVIDIA Jetson devices and allow people can use words to control the connections/interfaces on the board.
- This is the preparation…
-
**Is your feature request related to a problem? Please describe.**
Since the speedy evolement of LLMs and their various use of prompts, we need a way to specify a prompt from runtime, not only by cod…
-
It would be nice to have a sleep with a progress bar, and tqdm is in the perfect position to provide it!
Right now, people roll their own and might do something like this:
```
from time import sl…
-
Thank you again for your excellent work. I have trained a model mT0 using my own dataset, and it performs well. Now, I am attempting to train bloomz model, but I'm encountering an issue where the trai…