search

EvolvingLMMs-Lab / lmms-eval

Accelerating the development of large multimodal models (LMMs) with lmms-eval
https://lmms-lab.github.io/
Other
1.02k stars 52 forks source link

how to use “few shot” #91

Open woshidengweimo opened 1 month ago

woshidengweimo commented 1 month ago

is there an example of how to use "few shot"

how to set this two args:

(1)fewshot_split (str, optional) — Split in the dataset to draw few-shot exemplars from. assert that this not None if num_fewshot > 0. This function is not well tested so far (2)num_fewshot (int, optional, defaults to 0) — Number of few-shot examples before the input. This function is not well tested so far

Luodian commented 1 month ago

This is still work in progress. We developed it and succesfully test on textvqa. But this is not confirmed fully correct. You can see there's a PR. You may checkout it if you really need.