fix glm4 chat forward error

xusenlinzy / api-for-open-llm

Openai style api for open large language models, using LLMs just as chatgpt! Support for LLaMA, LLaMA-2, BLOOM, Falcon, Baichuan, Qwen, Xverse, SqlCoder, CodeLLaMA, ChatGLM, ChatGLM2, ChatGLM3 etc. 开源大模型的统一后端接口

Apache License 2.0

2.17k stars 254 forks source link

fix glm4 chat forward error #294

Closed AinzLimuru closed 5 days ago

AinzLimuru commented 6 days ago

apply_chat_template returns a one-dimensional array, [0] got a value instead of an array, causing exceptions in subsequent len operations.

xusenlinzy commented 5 days ago

确实是的，刚注意到glm4的tokenizer文件改动了