Open mrseanryan opened 6 months ago
Related - inspired by your article on Weights and Biases, I put together this fork that tries to include all steps and scripts to fine-tune v1.5 of LLaVA:
It could be interesting to see how to fine-tune v1.6 ...
Hi @mrseanryan , I am having an issue when I try to run the merge_lora_weights script.
!python /content/LLaVA/scripts/merge_lora_weights.py --model-path /content/drive/MyDrive/llava_output_final_v1/adapter_model.safetensors --model-base liuhaotian/llava-v1.5-7b --save-model-path /content/drive/MyDrive/llava_output_config/output/merged_model
Traceback (most recent call last):
File "/content/LLaVA/scripts/merge_lora_weights.py", line 22, in
Could you guide me how to fix this please? Thanks
Describe the issue
The very nice article has this script:
but the file it refers to
/root/LLaVA/scripts/zero2.json
is not in this repo.The file is probably this one:
https://github.com/haotian-liu/LLaVA/blob/main/scripts/zero2.json
should be at
./scripts/zero2.json
?