ymcui / Chinese-LLaMA-Alpaca

中文LLaMA&Alpaca大语言模型+本地CPU/GPU训练部署 (Chinese LLaMA & Alpaca LLMs)
https://github.com/ymcui/Chinese-LLaMA-Alpaca/wiki
Apache License 2.0
17.98k stars 1.84k forks source link

扩充词表后只修改embedding_size,没有修改lm_head的维度 #889

Closed cooper12121 closed 2 months ago

cooper12121 commented 3 months ago

提交前必须检查以下项目

问题类型

None

基础模型

None

操作系统

None

详细描述问题

 model.resize_token_embeddings(len(tokenizer)), 在代码中并没有找到修改了lm_head的维度, 那这样解码时岂不是还是只解码到旧词表对应的token 部分?

依赖情况(代码类问题务必提供)

# 请在此处粘贴依赖情况

运行日志或截图

No response

github-actions[bot] commented 2 months ago

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your consideration.

github-actions[bot] commented 2 months ago

Closing the issue, since no updates observed. Feel free to re-open if you need any further assistance.