-
### Describe the issue
The error is only raised after 1.18. I tried 1.17.3, and it works fine.
onnxruntime.capi.onnxruntime_pybind11_state.InvalidArgument: [ONNXRuntimeError] : 2 : INVALID_ARGUMEN…
-
When using ORPO to fine-tune mistral-7b-instruct-v0.3-bnb-4bit, after clicking orpo_trainer.train() to start, the following error message appears:
`-------------------------------------------------…
-
### Prerequisites
- [X] I am running the latest code. Mention the version if possible as well.
- [X] I carefully followed the [README.md](https://github.com/ggerganov/llama.cpp/blob/master/README.md)…
-
I'm encountering a KeyError when trying to train Phi-3 using the unsloth library. The error occurs during the generation step with model.generate. Below are the details of the code and the error trace…
-
Hi! I followed the conda installation and I am using Jupyter notebook in WSL2. System:
32GB RAM
RTX 3090 24GB
Ryzen 5 5600x
- No issues with gradient = True.
- I installed the latest version fr…
-
Used the following lines for env creation
****
conda create --name unsloth_env python=3.10
conda activate unsloth_env
conda install pytorch-cuda= pytorch cudatoolkit xformers -c pytorch -c nvi…
-
**Describe the bug**
I try to use pipeline parallelism with transformer, but I just found out it will be stuck in the mid
**To Reproduce**
Steps to reproduce the behavior:
```
#!/usr/bin/env py…
-
Code to reproduce:
```python
import trl
from unsloth import FastLanguageModel
import torch
from tqdm import tqdm
from transformers import AutoTokenizer
from datasets import load_dataset
fr…
-
**LocalAI version:**
OK:
- `local-ai-avx2-Linux-x86_64-1.40.0`
- `local-ai-avx2-Linux-x86_64-2.0.0`
- `local-ai-avx2-Linux-x86_64-2.8.0`
- `local-ai-avx2-Linux-x86_64-2.8.2`
- `local…
-
It would be convenient to allow the encoder [output_size](https://github.com/CUNY-CL/yoyodyne/blob/master/yoyodyne/models/modules/lstm.py#L99) to be different from the TransformerDecoder embedding siz…