-
I have installed as described in the gradio demo
It is literally filling entire 24 GB VRAM working but that much VRAM
what VRAM optimizations can be made? such as loading models perhaps 16 bit ?…
-
!pip install transformers datasets
from transformers import GPT2Tokenizer, GPT2LMHeadModel, Trainer, TrainingArguments
from datasets import load_dataset, load_metric
tokenizer = GPT2Tokenizer.from_…
-
I'm getting this error when attempting to run the program. Ideally, when faced with an unreadable character it would skip the file and raise a warning. Alternatively, it would be great if the error co…
-
### Describe the bug
When using compel and prompt embeddings, and performing inference with LoRA weights loaded, `lora_scale` doesn't work as expected. Specifically, if I do the following actions i…
-
- Create 10 queries with various timeframe expectations
- Run them with 2 agents (dust / slack)
- Check it works
-
### Your current environment
The output of `python collect_env.py`
```text
Collecting environment information...
PyTorch version: 2.4.0+cu121
Is debug build: False
CUDA used to build PyTor…
-
ragas 0.1.21, python3.9
code:
import nest_asyncio
nest_asyncio.apply()
from ragas.testset import TestsetGenerator
from ragas.testset.evolutions import simple, reasoning, multi_context
from langc…
-
### Current Behavior
I was trying to create a custom generator with a dropdown and I noticed that only values appear. I tried this:
```json
"type": {
"type": "string",
"descript…
-
Hi everyone! Amazing work, congratulations for the paper and thanks for open sourcing the code!
From what I understood and could test, the `src/edit_real.py` script perform an edit without the need…
-
#### What is your question?
I noticed that new FairSeq models support past, future and self targets for text generation tasks. However, I have been trying to figure out a way of implementing a gene…