pickle.UnpicklingError: invalid load key, 'v'.

[baiSongL]

how to solve the error: pickle.UnpicklingError: invalid load key, 'v'.

[SSshuishui]

i change the code in smoothquant/calibration.py get_act_scales() with " dataset = load_dataset( 'allenai/c4', 'allenai--c4', data_files={'validation': 'en/c4-validation.00000-of-00008.json.gz'}, split='validation' ) " then can get a scales

[gokucai]

Inspiration from @SSshuishui . I simply run generate_act_scales.py and generate a scales myself.

“ python examples/generate_act_scales.py \ --model-name ../models/opt/opt-13b \ --output-path ./opt-13b-scales.pt \ --num-samples 200 \ --seq-len 2048 \ --dataset-path ../datasets/lambada/lambada.py ”

Here i use lambada dataset.

But i run smoothquant in a server which has no internet access to hub. So i need to modify smoothquant/calibration.py to load dataset from local directory, otherwise it will failed. I change the code in smoothquant/calibration.py get_act_scales() functio with

" dataset = load_dataset(dataset_path, split="train") "

Then i can load a dataset locally rather than download from hugging face. Certainly after modifying code, you should run python setup.py install again to install the code after modified.

i change the code in smoothquant/calibration.py get_act_scales() with " dataset = load_dataset( 'allenai/c4', 'allenai--c4', data_files={'validation': 'en/c4-validation.00000-of-00008.json.gz'}, split='validation' ) " then can get a scales