EvolvingLMMs-Lab / lmms-eval

Accelerating the development of large multimodal models (LMMs) with lmms-eval
https://lmms-lab.github.io/
Other
1.03k stars 53 forks source link

How to add the new dataset? #58

Closed rese1f closed 2 months ago

rese1f commented 2 months ago

i've create the yaml file under the guidance. but it still not appear in available task list when calling lmms-eval --tasks list, what should I do?

kcz358 commented 2 months ago

You might want to set lmms-eval --tasks list --verbosity DEBUG to see why the task is not added into the list.

rese1f commented 2 months ago

it works thank you!