intel / xFasterTransformer

Apache License 2.0
344 stars 60 forks source link

Fix Qwen prompt.json #368

Closed JunxiChhen closed 4 months ago

marvin-Yu commented 4 months ago

Why do we need this modification?

JunxiChhen commented 4 months ago

Input token size is wrong for Qwen. This PR will fix this issue.