search

EvolvingLMMs-Lab / lmms-eval

Accelerating the development of large multimodal models (LMMs) with lmms-eval
https://lmms-lab.github.io/
Other
2.07k stars 153 forks source link

Evaluation speed #385

Open si0wang opened 3 weeks ago

si0wang commented 3 weeks ago

I have updated my transformers into 4.46.0, but the inference speed is extremely slow. Is there any solution?

kcz358 commented 3 weeks ago

May I ask what is your evaluation settings? I can't give any advise knowing only the transformers version