AttributeError: 'ChatGLMTokenizer' object has no attribute 'sp_tokenizer'

THUDM / VisualGLM-6B

Chinese and English multimodal conversational language model | 多模态中英双语对话语言模型

Apache License 2.0

4.07k stars 414 forks source link

AttributeError: 'ChatGLMTokenizer' object has no attribute 'sp_tokenizer' #285

Open becauseofAI opened 11 months ago

becauseofAI commented 11 months ago

'ChatGLMTokenizer' object has no attribute 'sp_tokenizer' when transformers>=4.34.0. Can you solve it? Thx! @Sleepychord @lykeven @cenyk1230 @Btlmd @1049451037 @dm-thu @mactavish91

xdedss commented 11 months ago

Same issue here. Downgrading to transformers==4.33.0 works for me.