YangYang-DLUT
commented
8 months ago Is it solved? I met the same problem.
Open ahnHeejune opened 1 year ago
YangYang-DLUT
commented
8 months ago Is it solved? I met the same problem.
(vicuna) ahnlab@ahnlab-desktop:~/GPT/StarCoder/GPTQ-for-SantaCoder$ python -m santacoder_inference bigcode/starcoderbase --wbits 4 --groupsize 128 --load starcoderbase-GPTQ-4bit-128g/model.pt Loading checkpoint shards: 100%|██████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 7/7 [01:12<00:00, 10.29s/it] Traceback (most recent call last): File "", line 198, in _run_module_as_main
File "", line 88, in _run_code
File "/home/ahnlab/GPT/StarCoder/GPTQ-for-SantaCoder/santacoder_inference.py", line 90, in
main()
File "/home/ahnlab/GPT/StarCoder/GPTQ-for-SantaCoder/santacoder_inference.py", line 80, in main
model = get_santacoder(args.model, args.load, args.wbits, args.groupsize)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/ahnlab/GPT/StarCoder/GPTQ-for-SantaCoder/santacoder_inference.py", line 40, in get_santacoder
model.load_state_dict(torch.load(checkpoint))
^^^^^^^^^^^^^^^^^^^^^^
File "/home/ahnlab/miniconda3/envs/vicuna/lib/python3.11/site-packages/torch/serialization.py", line 815, in load
return _legacy_load(opened_file, map_location, pickle_module, pickle_load_args)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/ahnlab/miniconda3/envs/vicuna/lib/python3.11/site-packages/torch/serialization.py", line 1033, in _legacy_load
magic_number = pickle_module.load(f, pickle_load_args)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
_pickle.UnpicklingError: invalid load key, 'v'.