deepseek-ai / DeepSeek-V2

DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Model
MIT License
3.47k stars 143 forks source link

多轮在训练中是否需要特殊间隔符,用什么间隔符号? #79

Open AceCHQ opened 1 month ago

AceCHQ commented 1 month ago

您好,感谢您的工作! 我看到Readme里的模版如下,请问如果是多轮,第一轮和第二轮之间的间隔符是否有特殊?谢谢

<|begin▁of▁sentence|>User: {user_message_1}

Assistant: {assistant_message_1}<|end▁of▁sentence|>User: {user_message_2}

Assistant: