lm-sys / FastChat

An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.
Apache License 2.0
36.56k stars 4.51k forks source link

chatglm3-6b-32k generate abnormal output like <|user|> and <|assistant|> #3421

Open npu-0 opened 3 months ago

npu-0 commented 3 months ago

model: https://huggingface.co/THUDM/chatglm3-6b-32k

run fastchat: image

after add some debug info, i think this code not working image image