Question about "token_type_ids"

huggingface / transfer-learning-conv-ai

🦄 State-of-the-Art Conversational AI with Transfer Learning

MIT License

1.74k stars 430 forks source link

Question about "token_type_ids" #120

Open Fengpei-Yuan opened 2 years ago

Fengpei-Yuan commented 2 years ago

For Line 63 of train.py, it seems that "sequence[0] = [[bos] + list(chain(*persona))]". In this case, sequence[0] will be assigned as speaker1 (i.e., the user), why is this?