what is the meaning of "kd" in BERT-small(6 layers)+Span+kd - Githubissues

lonePatient / BERT-NER-Pytorch

Chinese NER(Named Entity Recognition) using BERT(Softmax, CRF, Span)

MIT License

2.08k stars 427 forks source link

what is the meaning of "kd" in BERT-small(6 layers)+Span+kd #17

Closed tiandiweizun closed 4 years ago

lonePatient commented 4 years ago

@tiandiweizun Knowledge Distillation