transformers最新版本会报错

DLLXW / baby-llama2-chinese

用于从头预训练+SFT一个小参数量的中文LLaMa2的仓库；24G单卡即可运行得到一个具备简单中文问答能力的chat-llama2.

MIT License

2.47k stars 305 forks source link

Open somewordstoolate opened 10 months ago

somewordstoolate commented 10 months ago

使用transformers==4.35.2时会报错：AttributeError: 'ChatGLMTokenizer' object has no attribute 'tokenizer'、需要修改requirement.txt 的tranformers==4.33.2

Henry199898 commented 9 months ago

transformers==4.33.2，单词拼错了，少个s

foldleaf commented 7 months ago

根据requirement.txt新建了一个venv，还是会报错：AttributeError: 'ChatGLMTokenizer' object has no attribute 'tokenizer'. Did you mean: 'tokenize'?