-
Finetune vlm on mnist and rad_dataset
-
Hey,
Great to see LISA implemented here.
As for the background, I am trying to finetune models with LORA other techniques on domain data but the Task i am doing is Causal LM is Next word Predict…
-
作者您好,
祝贺你们的工作被Findings of ACL 2024接受!
这篇工作的数据集准备部分给了我很大启发,我在自己合成instruction ft datasets的时候发现有部分步骤不太完整:
1. 在2.1 Graph Caption Generation 部分的 group (1) **Wikipedia + Wikidata5M** 中,我加载的是了wiki5…
-
How to finetuning the model (with LoRa)? The pytorch_lightning pipeline is hard to understand and modify. Can you give some API or pipeline?
-
Hi,
Is there any option or improvement on finetuning LASER for specific areas?
Thank you!
0x01h updated
5 years ago
-
Hi,
Thanks for this repo!
I am trying to finetune VGGNet using the code given in the example. I tried the image_preloader on my dataset, but it threw errors while loading a few files (which PIL …
-
First, would like to thanks ostris for this amazing tool, after tried Kohya and Simpletuner, ai-tool kit give me better results with a great ease. Would like to know if they're is a plan for create a …
-
Hi,
Did you try using multi-GPU for training?
I am hoping to finetune your model with 1/10 of the learning rate.
Wondering what is the change needed if using 8 GPU.
-
# I am planning to perform a two-stage fine-tuning process and need some guidance on how to proceed.
## First Stage
1. Load Base Model: I start by loading the base model, qwen1.5 32B.
2. Appl…
-
During the use of LoRA fine-tuning, everything was normal, but the following issue arose during full-scale fine-tuning.
I use the following script for full fine-tuning :
```shell
#!/bin/bash
N…