open-compass / VLMEvalKit

Open-source evaluation toolkit of large vision-language models (LVLMs), support ~100 VLMs, 40+ benchmarks
https://huggingface.co/spaces/opencompass/open_vlm_leaderboard
Apache License 2.0
1.08k stars 154 forks source link

convert base64 images -> disk to memory #426

Closed lerogo closed 4 weeks ago

lerogo commented 4 weeks ago

Replace the operation of writing to disk when converting base64 images with in-memory operations to improve performance.