Size mismatch for tok_embeddings.weight

meta-llama / llama3

The official Meta Llama 3 GitHub site

Other

24.04k stars 2.61k forks source link

Size mismatch for tok_embeddings.weight #139

Open HarryHuangYZ opened 3 months ago

HarryHuangYZ commented 3 months ago

RuntimeError: Error(s) in loading state_dict for Transformer: size mismatch for tok_embeddings.weight: copying a param with shape torch.Size([16032, 16384]) from checkpoint, the shape in current model is torch.Size([32064, 8192]).

AWangji commented 3 months ago

same, how do you resolve it?