lonePatient / BERT-NER-Pytorch

Chinese NER(Named Entity Recognition) using BERT(Softmax, CRF, Span)
MIT License
2.05k stars 425 forks source link

softmax和crf性能差距很大,参数一致,请教如何看原因调效果? #92

Open northfun opened 1 year ago

northfun commented 1 year ago

epoch: 10 train_batch_size: 8 evaluation_batch_size: 16 learning_rate: 3e-5

预训练模型:bert_base_chinese

自己的中文数据集

bert+softmax: acc: 0.0729 - recall: 0.4249 - f1: 0.1245 - loss: 1.0244

bert+crf: acc: 0.4268 - recall: 0.5729 - f1: 0.4892 - loss: 34.9675

在google bert上跑 accuracy: 85.46%; precision: 36.28%; recall: 48.35%; FB1: 41.45