No "llava_llama_3" template

EvolvingLMMs-Lab / lmms-eval

Accelerating the development of large multimodal models (LMMs) with lmms-eval

https://lmms-lab.github.io/

Other

1.02k stars 52 forks source link

No "llava_llama_3" template #88

Open yqy2001 opened 1 month ago

yqy2001 commented 1 month ago

Hello! I am evaluating the llava-next-llama-3-8b model using lmms-eval, meeting this bug:

  File "lmms-eval/lmms_eval/models/llava.py", line 358, in generate_until
    conv = copy.deepcopy(conv_templates[self.conv_template])
KeyError: 'llava_llama_3'

It seems that there does not exist a conversational template called llava_llama_3. Can you help with that? Thank you!

kcz358 commented 1 month ago

Hi, may I ask which repo you used to install llava? If you want to use the llava-next-llama-3-8b, you might need to use the newest LLaVA-NeXT repo to install llava.

yqy2001 commented 1 month ago

Got it. Thank you! I used the original llava. I will have a try