-
How to finetuning the model (with LoRa)? The pytorch_lightning pipeline is hard to understand and modify. Can you give some API or pipeline?
-
Hi,
Did you try using multi-GPU for training?
I am hoping to finetune your model with 1/10 of the learning rate.
Wondering what is the change needed if using 8 GPU.
-
# I am planning to perform a two-stage fine-tuning process and need some guidance on how to proceed.
## First Stage
1. Load Base Model: I start by loading the base model, qwen1.5 32B.
2. Appl…
-
Hi,
Is there any option or improvement on finetuning LASER for specific areas?
Thank you!
0x01h updated
5 years ago
-
Hi,
Thanks for this repo!
I am trying to finetune VGGNet using the code given in the example. I tried the image_preloader on my dataset, but it threw errors while loading a few files (which PIL …
-
Hi,
Can you upload the retrieval fine-tuning model? Thank you!
-
Hi @gabrieltseng, I've read your paper and find it a really interesting work!
Thanks a lot for sharing your code as well!
I'm trying to adapt your downstream task [notebook](https://github.com/na…
-
I followed the tutorial at `train/finetune_example/mpt-7b-arc-easy--gpu.yaml` and added an additional evaluation using `icl_tasks: 'eval/yamls/tasks_light.yaml'` in order to evaluate accuracy on ARC E…
-
During the use of LoRA fine-tuning, everything was normal, but the following issue arose during full-scale fine-tuning.
I use the following script for full fine-tuning :
```shell
#!/bin/bash
N…
-
Hello!
I am trying to finetune either the vit_s or vit_b models to my dataset. I have tried training only the dino head, both the dino and ibot heads, and keeping the whole backbone frozen or unfr…