search

microsoft / LLaVA-Med

Large Language-and-Vision Assistant for Biomedicine, built towards multimodal GPT-4 level capabilities.
Other
1.29k stars 148 forks source link

How to use llava-v1.6-mistral-7b training #72

Open xuzhaoyang-svg opened 1 month ago

xuzhaoyang-svg commented 1 month ago

Thank you for your work. How can the current code be modified to use llava-v1.6-mistral-7b for training this medical model?

displaywz commented 4 weeks ago

I think it is sufficient to directly use the official warehouse of LLaVA to retrain the first and second stages.

NicoZenith commented 3 weeks ago

unfortunately there is not training script provided by the original LLaVA repo for 1.6