-
### Question
I downloaded '_llava-1.5-7b_' as '_model_base_', and downloaded the lora wights '_llava-v1.5-7b-lora_' as '_model_path_'.
I ran the vqav2.sh provided by the author, trying to reproduc…
-
在 `colab` 环境，执行 **llama3** `lora` 微调报错：NotImplementedError: Cannot copy out of meta tensor; no data! 。微调代码如下：
```python
import pandas as pd
from modelscope import snapshot_download
import torch
f…
-
Hello, I am having some issues when training a bipolar LoRA slider - a LoRA that supports negative and positive values. My goal is for negative values to yield to opposite of positive values, i.e. for…
-
```py
from unsloth import FastLanguageModel
from unsloth import is_bfloat16_supported
import torch
from unsloth.chat_templates import get_chat_template
from trl import SFTTrainer
from transform…
-
In the Gemma 7b notebook, when rslora and dora are active, and the settings for 4-bit and 8-bit are off with r=8 and alpha=16, I encounter an error as described below. I have targeted all linear layer…
-
## Description
As an AlgoKit user
I want to download and install lora
So that I have quick and easy access to the features it provides
As an AlgoKit user
I want to use the installed lora app
So that…
-
### Category
WiFi
### Hardware
T-Lora v2 1.6
### Firmware Version
2.4.x
### Description
Ever since I've upgraded my T-LoRas to 2.4.x I'm experiencing issues in keeping the nodes u…
-
When I run the code:
`
TEXT_ENCODER_REPLACE_MODULES = {"LlamaAttention"}
tokenizer = LlamaTokenizer.from_pretrained(llama2_dir)
text_encoder = LlamaForCausalLM.from_pretrained(llama2_dir, torch_dt…
-
### Describe the bug
I am using the training script documented here https://github.com/huggingface/diffusers/blob/main/examples/dreambooth/README_flux.md to train a LORA on my dataset.
here is th…
-
Hi,
Thank you very much for sharing your implementation!
I encountered an issue, and since I am new to the Diffuser library, I was hoping you could guide me on how to run these code and how to g…