search

01-ai / Yi-1.5

Yi-1.5 is an upgraded version of Yi, delivering stronger performance in coding, math, reasoning, and instruction-following capability.
Apache License 2.0
355 stars 20 forks source link

tokenizer bug #35

Closed ZixinxinWang closed 6 days ago

ZixinxinWang commented 6 days ago

您好，在我使用Yi1.5时，发现会出现decode问题，会在解码时出现很多空格，如： 6531719891243_ pic

的输出为 6541719891252_ pic 请问是什么原因？