mlcommons / inference

Reference implementations of MLPerf™ inference benchmarks
https://mlcommons.org/en/groups/inference
Apache License 2.0
1.15k stars 508 forks source link

【GPT-J】checkpoint.zip download Incompletely #1674

Open WhateverSir opened 3 months ago

WhateverSir commented 3 months ago

i download checkpoint.zip : wget https://cloud.mlcommons.org/index.php/s/QAZ2oM94MkFtbQx/download --output-document checkpoint.zip but with error pytorch checkpoint file cannot load when i unzip checkpoint.zip,i found it lacks pytorch_model-00002-of-00003.bin this file. So i download pytorch_model.bin form Huggingface; according pytorch_model.bin.index.json,i split pytorch_model.bin to get this file: pytorch_model-00002-of-00003.bin but i run: python3 main.py --scenario=Offline --model-path=./model/ --dataset-path=./data/cnn_eval.json --max_examples=16 it raise ValueError: Trying to set a tensor of shape torch.Size([50400, 4096]) in "weight" (which has shape torch.Size([50401, 4096])), this look incorrect. can @mlcommons-bot help me?

nathanw-mlc commented 3 months ago

It sounds like you're using old download instructions. Try the new download instructions here.