-
Hi thanks for the library! https://github.com/unslothai/unsloth is a library that supports fast PEFT fine-tuning. Therefore, I wonder whether this is / will be compatible with that?
-
https://github.com/unslothai/unsloth
-
### Reminder
- [X] I have read the README and searched the existing issues.
### System Info
Linux
### Reproduction
```
ERROR: pip's dependency resolver does not currently take into ac…
-
[sft.zip](https://github.com/user-attachments/files/17394377/sft.zip)
[ruozhiba_cvt.zip](https://github.com/user-attachments/files/17394510/ruozhiba_cvt.zip)
I try to fine-tune the ruozhiba datase…
-
cannot import name 'patch_compiled_autograd' from 'unsloth_zoo.patching_utils' (/usr/local/lib/python3.10/dist-packages/unsloth_zoo/patching_utils.py
这是什么原因，看起来是版本问题，如何对其版本？谢谢！
-
Hi, running this code:
`from unsloth import FastLanguageModel`
I get this error:
```
---------------------------------------------------------------------------
ImportError …
-
I want to run [sft](https://github.com/huggingface/peft/tree/main/examples/sft) example and I get some erros, Can you help me to find the problem?
I run [run_peft_fsdp.sh](https://github.com/huggin…
-
When loading the model [unsloth/Meta-Llama-3.1-8B-Instruct-bnb-4bit](https://huggingface.co/unsloth/Meta-Llama-3.1-8B-Instruct-bnb-4bit), I have the error : `AssertionError: model.safetensors.index.…
-
Need to experiment with this solutions and decide if lora can be implemented on CPU
- [x] unsloth
- [x] axolotl
- [x] llama factory
- [x] text-gen-ui *
-
Hi @coljac , thanks for this. I was checking if I could do this myself, with some Dockerfile to ensure it will work despite being updated
I think this installs unsloth based on main branch, and wha…