search

open-compass / VLMEvalKit

Open-source evaluation toolkit of large vision-language models (LVLMs), support 160+ VLMs, 50+ benchmarks
https://huggingface.co/spaces/opencompass/open_vlm_leaderboard
Apache License 2.0
1.34k stars 188 forks source link

评测时PermissionError: [Errno 13] Permission denied #454

Closed 40459447 closed 1 month ago

40459447 commented 2 months ago

Traceback (most recent call last): File "D:\opencompass1\VLMEvalKit\run.py", line 223, in main() File "D:\opencompass1\VLMEvalKit\run.py", line 137, in main model = infer_data_job( File "D:\opencompass1\VLMEvalKit\vlmeval\inference.py", line 162, in infer_data_job model = infer_data( File "D:\opencompass1\VLMEvalKit\vlmeval\inference.py", line 102, in infer_data supp = infer_data_api( File "D:\opencompass1\VLMEvalKit\vlmeval\inference.py", line 60, in infer_data_api track_progress_rich(gen_func, structs, nproc=api_nproc, chunksize=api_nproc, save=out_file, keys=indices) File "D:\opencompass1\VLMEvalKit\vlmeval\utils\mp_util.py", line 188, in track_progress_rich raise e File "D:\opencompass1\VLMEvalKit\vlmeval\utils\mp_util.py", line 174, in track_progress_rich ans = load(save) File "D:\opencompass1\VLMEvalKit\vlmeval\smp\file.py", line 177, in load return handlerssuffix File "D:\opencompass1\VLMEvalKit\vlmeval\smp\file.py", line 150, in load_pkl return pickle.load(open(pth, 'rb')) PermissionError: [Errno 13] Permission denied

kennymckormick commented 2 months ago

Hi, @40459447 , The toolkit is developed for Linux and we are not sure if it runs properly on Windows platform