EvolvingLMMs-Lab / lmms-eval

Accelerating the development of large multimodal models (LMMs) with lmms-eval
https://lmms-lab.github.io/
Other
1.02k stars 52 forks source link

Multinode Evaluation #72

Open yqy2001 opened 1 month ago

yqy2001 commented 1 month ago

Hello, does the current code support multinode evaluation?

Thanks.

Luodian commented 1 month ago

Sorry, it's not supported by design, same issue with our parent framework lm-evaluation-harness

yqy2001 commented 1 month ago

Got it. Thank you for the response!