What and where is the Loss function used in LLAVA-MED

microsoft / LLaVA-Med

Large Language-and-Vision Assistant for Biomedicine, built towards multimodal GPT-4 level capabilities.

Other

1.29k stars 148 forks source link

What and where is the Loss function used in LLAVA-MED #54

Open peterphancong opened 3 months ago

peterphancong commented 3 months ago

Hi authors, I am trying to finetune the LLAVA-MED with my custom classification purpose, and I would like to know what is the loss function used in LLAVA-MED, and is it possible to update for my custom training?