-
### Is there an existing issue for this?
- [X] I have searched the existing issues
### Does this issue exist in the latest version?
- [X] I'm using the latest release
### Describe the bug?
As pre…
-
# URL
- https://arxiv.org/abs/2311.08711
# Affiliations
- Zhihan Zhang, N/A
- Dong-Ho Lee, N/A
- Yuwei Fang, N/A
- Wenhao Yu, N/A
- Mengzhao Jia, N/A
- Meng Jiang, N/A
- Francesco Barbie…
-
Hello, authors!
Thanks for your valuable work! I am trying to run `zero_shot.py` on my own dataset using the `PA-LLaVA` checkpoint. Could you please clarify which checkpoint the `--llava ./instruct…
lsnls updated
1 month ago
-
Hello dear Tongyi SpeechTeam
I am interested with the controllable generation via instruction, and I want to fine-tune the model with my own version of data. Based on this, my question is, are there …
-
### Describe the issue
Issue:
I am finetuning llava1.5-7B on 8 * A100 40G, and modified bs & accumulation steps accordingly.
The estimated training time is approx. 24h.
What could go wrong?
En…
-
I find `@torch.no_grad()` in CLIPVisionTower.forward(), so it won't flow gradient to CLIP while training.
https://github.com/haotian-liu/LLaVA/blob/c121f0432da27facab705978f83c4ada465e46fd/llava/mo…
-
Thanks for your excellent work. I am curious if there are any instructions for fine-tuning video-llava on my own dataset?
-
Yi Coder 1.5b is potentially a great model for fine-tuning on one's own codebase. It'd be great if you could release some SAMPLE portions of the dataset used for base training & instruction tuning (an…
-
I recently fine-tuned the Qwen2-VL 7B Instruct model using LoRA, with the USE_HF=1 environment variable set during fine-tuning. However, I am unable to find a way to merge the fine-tuned model and exp…
-
- Here's the summary of consulting a LLM specialist:
---
- We have an initial thought in #74 as follows:
![image](https://github.com/user-attachments/assets/265a3d7d-0454-4e7b-9c99-a0dd9f9ecf7c…