search

LLaVA-VL / LLaVA-NeXT

Apache License 2.0
2.52k stars 186 forks source link

Training/Finetunning code please #41

Open dragen1860 opened 4 months ago

dragen1860 commented 4 months ago

Hi, Dear author: It seems the llava-next is really insightful exploreing work. Please kindly release the training and inference code asap, thank you very much.

n2nco commented 4 months ago

+1 would love to try out a qlora/lora fine tune

caixiaoniweimar commented 3 months ago

+1 up

lqqyyy commented 3 months ago

+1

NicoZenith commented 3 months ago

what do you guys think of this ? https://github.com/NielsRogge/Transformers-Tutorials/blob/master/LLaVa/Fine_tune_LLaVa_on_a_custom_dataset_(with_PyTorch_Lightning).ipynb

By replacing llava by lava-next (processor and model)

chuangchuangtan commented 3 months ago

I implement an LLava-llama3 Lora finetuning https://github.com/chuangchuangtan/LLaVA-NeXT-Image-Llama3-Lora