search

QwenLM / qwen.cpp

C++ implementation of Qwen-LM
Other
514 stars 42 forks source link

推理失败 #13

Closed 1994 closed 9 months ago

1994 commented 9 months ago

Assertion failed: (encoder.size() != decoder.size() && "Encoder and decoder must be of equal length; maybe you had duplicate token indices in your encoder?"), function tiktoken, file tiktoken.h, line 139

simonJJJ commented 9 months ago

Do you use the qwen.tiktoken file?

1994 commented 9 months ago

Do you use the qwen.tiktoken file?

指定了的

image

1994 commented 9 months ago

奇怪，重新编译后不出现了

NorthSummer commented 7 months ago

hi, may I ask have you solved this problem? I also encounter this bug, and I download checkpoints from modelscope.