AttributeError 'Qwen2Tokenizer object bas no attribute 'legacy'

QwenLM / Qwen2

Qwen2 is the large language model series developed by Qwen team, Alibaba Cloud.

7.43k stars 454 forks source link

AttributeError 'Qwen2Tokenizer object bas no attribute 'legacy' #337

Closed wangxin52791 closed 3 months ago

wangxin52791 commented 4 months ago

jklj077 commented 4 months ago

As the error suggests, Qwen2Tokenizer has no attribute legacy. It is an attribute normally for sentencepiece-based tokenizers. Please kindly report to the KarmaVLM maintainers.