search

LLaVA-VL / LLaVA-Plus-Codebase

LLaVA-Plus: Large Language and Vision Assistants that Plug and Learn to Use Skills
https://llava-vl.github.io/llava-plus/
Apache License 2.0
698 stars 53 forks source link

[Question] Finetuning bash file #28

Open AlirezaShamsoshoara opened 4 months ago

AlirezaShamsoshoara commented 4 months ago

Question

Hey, I was wondering if anyone has run the fine-tuning with Lora for LLava-plus? I can run it with visiontower and image_data, but the results are not good. I was wondering if the fine-tuning script (bash) is the same as: https://github.com/haotian-liu/LLaVA/blob/main/scripts/v1_5/finetune_task_lora.sh and https://github.com/haotian-liu/LLaVA/blob/main/scripts/v1_5/finetune_task.sh ?