THUDM / ChatGLM3

ChatGLM3 series: Open Bilingual Chat LLMs | 开源双语对话语言模型
Apache License 2.0
13.39k stars 1.55k forks source link

call tool 微调,报错 #1176

Closed koryako closed 5 months ago

koryako commented 5 months ago

System Info / 系統信息

tool 微调代码是否调整过了?

  if tools is not None:
            raise NotImplementedError()

        for message in conv:
            if message['role'] in ('system', 'user'):
                loss_mask_val = False
            else:
                loss_mask_val = True

            if message['role'] == 'tool':
                raise NotImplementedError()
            else:
                new_input_ids = tokenizer.build_single_message(
                    message['role'], '', message['content']
                )
                new_loss_masks = [loss_mask_val] * len(new_input_ids)

Who can help? / 谁可以帮助到您?

No response

Information / 问题信息

Reproduction / 复现过程

报错了

Expected behavior / 期待表现

新版代码可以微调 tool 模式

zRzRzRzRzRzRzR commented 5 months ago

嗯,2月份之后这个版本就没有tools的微调了