-
Attempting to generate with Mistral Small causes this error:
---------------------------------------------------------------------------
RuntimeError Traceback (most r…
-
**Issue Title**: RuntimeError: cutlassF: No kernel found to launch in `sample_t2v.py`
**Description**:
I encountered an error when running the code in `opensora/sample/sample_t2v.py`. The specif…
-
from trl import SFTTrainer
from transformers import TrainingArguments
from unsloth import is_bfloat16_supported
trainer = SFTTrainer(
model = model,
tokenizer = tokenizer,
train_da…
-
I want to fine-tune a model using unsloth. Every thing works fine on colab but on my system I got the following:
{
"name": "NotImplementedError",
"message": "No operator found for `memory_efficie…
-
### Describe the issue
The error is only raised after 1.18. I tried 1.17.3, and it works fine.
onnxruntime.capi.onnxruntime_pybind11_state.InvalidArgument: [ONNXRuntimeError] : 2 : INVALID_ARGUMEN…
-
Used the following lines for env creation
****
conda create --name unsloth_env python=3.10
conda activate unsloth_env
conda install pytorch-cuda= pytorch cudatoolkit xformers -c pytorch -c nvi…
-
I installed PEFT from source.
And use the latest versions of Transformers and TRL.
I passed the XLoRA model to TRL but the training doesn't seem to work (training loss doesn't decrease and validatio…
-
Hi! I followed the conda installation and I am using Jupyter notebook in WSL2. System:
32GB RAM
RTX 3090 24GB
Ryzen 5 5600x
- No issues with gradient = True.
- I installed the latest version fr…
-
```python
import time
import torch
from torch.nn import functional as F
from flash_attn import flash_attn_func
from einops import rearrange
import math
def standard_attention(query_layer, key…
-
When using ORPO to fine-tune mistral-7b-instruct-v0.3-bnb-4bit, after clicking orpo_trainer.train() to start, the following error message appears:
`-------------------------------------------------…