Open becauseofAI opened 11 months ago
'ChatGLMTokenizer' object has no attribute 'sp_tokenizer' when transformers>=4.34.0. Can you solve it? Thx! @Sleepychord @lykeven @cenyk1230 @Btlmd @1049451037 @dm-thu @mactavish91
Same issue here. Downgrading to transformers==4.33.0 works for me.
'ChatGLMTokenizer' object has no attribute 'sp_tokenizer' when transformers>=4.34.0. Can you solve it? Thx! @Sleepychord @lykeven @cenyk1230 @Btlmd @1049451037 @dm-thu @mactavish91