search

open-compass / MMBench

Official Repo of "MMBench: Is Your Multi-modal Model an All-around Player?"
Apache License 2.0
135 stars 8 forks source link

where is the images in dataset? #33

Open ALR-alr opened 2 months ago

ALR-alr commented 2 months ago

where can i download them?

ALR-alr commented 2 months ago

I had come across the multimodal dataset where the image url is given. But in this MMBench dataset, only image path is given. How can I deal with it? LOOKING FORWARD TO YOUR REPLY!

kennymckormick commented 2 months ago

Please refer to the README to load and parse the dataset:

image

ALR-alr commented 2 months ago

thanks very much for your reply! When I received your reply in the morning, I started to configure the vlmeval environment. In the afternoon, the laboratory server was unexpectedly shut down. Now I have no cuda, so I can't verify it immediately. Will the output here means running the vlmeval package can automatically download pictures ? I see that it outputs a local file path like " 'value': '/root/LMUData/image/MMBench/241,jpg'".

ALR-alr commented 2 months ago

Thank you very much.

ALR-alr commented 2 months ago

Please refer to the README to load and parse the dataset:

image

Oh I see, it's magical! A string encoded by base_64 can be decoded to a picture!