hiyouga / ChatGLM-Efficient-Tuning

Fine-tuning ChatGLM-6B with PEFT | 基于 PEFT 的高效 ChatGLM 微调
Apache License 2.0
3.66k stars 471 forks source link

ptuning后,模型参数不匹配 #383

Closed HLF217 closed 1 year ago

HLF217 commented 1 year ago

报错如下: size mismatch for embedding.weight: copying a param with shape torch.Size([64, 14336]) from checkpoint, the shape in current model is torch.Size([128, 14336]).