songyingxin / Bert-TextClassification

Implemention some Baseline Model upon Bert for Text Classification
Other
682 stars 149 forks source link

请教下BertOrigin和BertAtt的区别?Bert本身不就是有Attention的吗? #29

Closed KinyaQ closed 1 year ago

KinyaQ commented 1 year ago

通过chatgpt搞懂了,是在微调阶段额外加入了一个显式的注意力机制