search

namisan / mt-dnn

Multi-Task Deep Neural Networks for Natural Language Understanding
MIT License
2.22k stars 411 forks source link

Why F1-score 82.7% in paper, but 87.6% in glue benchmark？ #128

Closed littlepan0413 closed 4 years ago

littlepan0413 commented 4 years ago

Why is there such a big improvement? What is the difference?

namisan commented 4 years ago

Please refer our paper for details. Xiaodong Liu, Pengcheng He, Weizhu Chen and Jianfeng Gao Multi-Task Deep Neural Networks for Natural Language Understanding ACL 2019 *: Equal contribution

Xiaodong Liu, Pengcheng He, Weizhu Chen and Jianfeng Gao Improving Multi-Task Deep Neural Networks via Knowledge Distillation for Natural Language Understanding arXiv version

Pengcheng He, Xiaodong Liu, Weizhu Chen and Jianfeng Gao Hybrid Neural Network Model for Commonsense Reasoning arXiv version