search

shikras / shikra

Other
734 stars 46 forks source link

ValueError: Trying to set a tensor of shape torch.Size([32003, 4096]) in "weight" (which has shape torch.Size([32000, 4096])), this look incorrect. #57

Closed qinbaigao closed 9 months ago

qinbaigao commented 9 months ago

When I load "shikra-7b-delta-v1": _delta = ShikraLlamaForCausalLM.from_pretrained(delta_path, torch_dtype=torch.float16, low_cpu_memusage=True),I have this issue: ValueError: Trying to set a tensor of shape torch.Size([32003, 4096]) in "weight" (which has shape torch.Size([32000, 4096])), this look incorrect.

pange1802703882 commented 3 months ago

Sorry, How to solve this problem ?

pange1802703882 commented 3 months ago

My error is " RuntimeError: The size of tensor a (32003) must match the size of tensor b (32016) "