Which 100 samples did you use for each dataset?

pliang279 / HEMM

Holistic evaluation of multimodal foundation models

MIT License

41 stars 0 forks source link

Which 100 samples did you use for each dataset? #33

Closed Qinyu-Allen-Zhao closed 4 months ago

Qinyu-Allen-Zhao commented 4 months ago

Hi!

Thank you for your great work! I'm wondering where to find the list of 100 sample you used for each dataset. The whole datasets are too big for us to run.

Best regards, Qinyu

akshayg08 commented 4 months ago

We used the top 100 samples from each evaluation set.

Qinyu-Allen-Zhao commented 4 months ago

Thank you!!! I see!