EvolvingLMMs-Lab / lmms-eval

Accelerating the development of large multimodal models (LMMs) with lmms-eval
https://lmms-lab.github.io/
Other
1.03k stars 54 forks source link

How to load dataset in offline mode? #23

Closed pipixin321 closed 3 months ago

pipixin321 commented 3 months ago

Since my server can't access huggingface.co, how can I load dataset from local direction? Thank you for your contributions!

kcz358 commented 3 months ago

Hi, you can refer to

15 and #21

pipixin321 commented 3 months ago

Thanks, I solve this problem by defining local_dir in lmms-eval/lmms_eval/api/task.py line.528

self.DATASET_PATH = os.path.join(local_dir, self.config.dataset_path)