THUDM / GLM-4

GLM-4 series: Open Multilingual Multimodal Chat LMs | 开源多语言多模态对话模型
Apache License 2.0
3.28k stars 235 forks source link

Maybe wrong in the code? #251

Closed Gary-code closed 3 days ago

Gary-code commented 3 days ago

System Info / 系統信息

4090

Who can help? / 谁可以帮助到您?

x

Information / 问题信息

Reproduction / 复现过程

new_input_ids = tokenizer.apply_chat_template([message], tokenize=True, return_dict=False)[2:] should be new_input_ids = tokenizer.apply_chat_template([message], tokenize=True, return_dict=False)[0][2:]?

Expected behavior / 期待表现

new_input_ids = tokenizer.apply_chat_template([message], tokenize=True, return_dict=False)[2:] should be new_input_ids = tokenizer.apply_chat_template([message], tokenize=True, return_dict=False)[0][2:]?

zRzRzRzRzRzRzR commented 3 days ago

Pull the latest hf file, chat_template has been placed in jinjia