-
I am trying to finetune Qwen-2.5 Coder-7B-Instruct on my custom dataset but am getting the following error:
``
ValueError: Unsloth: Untrained tokens of [[]] found, but embed_tokens & lm_head not t…
-
Hi. Something (possibly not unsloth) changed between July and now.
I am getting an unexpected OOM error trying to do a LORA finetune. This worked before, but is now barfing.
Looked at #338, but not…
-
/kind bug
**What steps did you take and what happened:**
I tried to integrate RayServe in my custom predictor of Inference service. Followed the below documentation as is
https://kserve.github.i…
-
We could easily ship the unsloth cli (`unsloth-cli.py`) with the python package thereby increasing its portability and adoption.
## Proposed Changes
* migrate `unsloth-cli.py` to `unsloth/cli.p…
-
Unsloth Question do you support omnigen?
-
Code:
```
from unsloth import FastLanguageModel
import torch
max_seq_length = 16384 # Choose any! We auto support RoPE Scaling internally!
dtype = None # None for auto detection. Float16 for Te…
-
pip install "unsloth[cu121-ampere-torch240] @ git+https://github.com/unslothai/unsloth.git"
pip install "unsloth[cu118-ampere-torch240] @ git+https://github.com/unslothai/unsloth.git"
pip install "u…
-
So, I have a macbook, and when i run my model on it, i bascially get an error saying no CUDA device found. I know that there is no gpu on macbooks, so does that mean that I cannot run my model on my m…
-
```
Unsloth: Offloading input_embeddings to disk to save VRAM
Unsloth: Offloading input_embeddings to disk to save VRAM
Traceback (most recent call last):
File "/data/llmodel/Tools/software_inst…
-
I get this error:
```
Traceback (most recent call last):
File "/home/denis/Documents/ai/unsloth/llama3-chat-template.py", line 20, in
model, tokenizer = FastLanguageModel.from_pretrained(…