search

InternLM / xtuner

An efficient, flexible and full-featured toolkit for fine-tuning LLM (InternLM2, Llama3, Phi3, Qwen, Mistral, ...)
https://xtuner.readthedocs.io/zh-cn/latest/
Apache License 2.0
3.97k stars 310 forks source link

intern2.5-20B微调 后词表长度不一致 #933

Open topology1 opened 2 months ago

topology1 commented 2 months ago

您好，intern2.5-20B微调合并后出现了added_tokens.json，转换gguf模型的时候是成功的，加载的时候显示tensor 'token_embd.weight' has wrong shape; expected 6144, 92550, got 6144, 92544，好像是词表长度不一致，请问怎么办？