search

ssbuild / chatglm_finetuning

chatglm 6b finetuning and alpaca finetuning
1.54k stars 176 forks source link

input_ids格式是否需要<CLS> #237

Open Jong-Won opened 1 year ago

Jong-Won commented 1 year ago

现在finetune时候input_ids的格式为:

<q0>, ... , <qn> [gMASK] <sop> <a0>, ... , <an> <eop> <eop>

请问是否需要在句子开始时加上<CLS> token呢？