search

turingmotors / heron

Apache License 2.0
164 stars 25 forks source link

Support LLaVA Training Strategy #44

Closed Onely7 closed 5 months ago

Onely7 commented 6 months ago

Support LLaVA Training Strategy

I have integrated Huggingface's LLaVA implementation (https://github.com/huggingface/transformers/blob/main/src/transformers/models/llava/modeling_llava.py) into heron. A new directory /heron/models/llava_llm was created to handle LLaVA's training strategies. Currently, the only supported LLM is Llama-2.

Onely7 commented 5 months ago

一旦、頂いたコメントを反映して、問題なく、学習が回るところまで確認できました！ マージお願いします。