How to use llava-v1.6-mistral-7b training

microsoft / LLaVA-Med

Large Language-and-Vision Assistant for Biomedicine, built towards multimodal GPT-4 level capabilities.

Other

1.59k stars 202 forks source link

Open xuzhaoyang-svg opened 6 months ago

xuzhaoyang-svg commented 6 months ago

Thank you for your work. How can the current code be modified to use llava-v1.6-mistral-7b for training this medical model?

displaywz commented 5 months ago

I think it is sufficient to directly use the official warehouse of LLaVA to retrain the first and second stages.

NicoZenith commented 5 months ago

unfortunately there is not training script provided by the original LLaVA repo for 1.6

wwxxyy1996 commented 4 months ago

Hello, I meet the same question. Have you solved it? BTW, I only see llava-med-v1.5-mistral-7b, which one is llava-med-v1.6-mistral-7b?