baichuan2的chat template - Githubissues

shibing624 / MedicalGPT

MedicalGPT: Training Your Own Medical GPT Model with ChatGPT Training Pipeline. 训练医疗大模型，实现了包括增量预训练(PT)、有监督微调(SFT)、RLHF、DPO、ORPO。

Apache License 2.0

3.24k stars 492 forks source link

baichuan2的chat template #262

Closed w5688414 closed 7 months ago

w5688414 commented 10 months ago

Describe the Question

Please provide a clear and concise description of what the question is.

我看了一下baichuan2的chat template。https://github.com/shibing624/MedicalGPT/blob/474b32c352423b4051dbf07b53cd6d585f7ab41e/supervised_finetuning.py#L562C18-L562C30 reserved_106是从哪里来的，我在官方的代码里面没找到。https://huggingface.co/baichuan-inc/Baichuan2-7B-Chat/blob/main/modeling_baichuan.py

shibing624 commented 10 months ago

仔细看下。 https://huggingface.co/baichuan-inc/Baichuan2-13B-Chat/blob/main/modeling_baichuan.py#L801