search

macanv / BERT-BiLSTM-CRF-NER

Tensorflow solution of NER task Using BiLSTM-CRF model with Google BERT Fine-tuning And private Server services
https://github.com/macanv/BERT-BiLSMT-CRF-NER
4.67k stars 1.25k forks source link

训练过程具体是怎么样的 #396

Open zacharykzhao opened 2 years ago

zacharykzhao commented 2 years ago

我用您的模型在自己的模型上训练， 请问训练过程是

  1. random initialization -> fine-tuning with a fixed learning rate 还是
  2. freezing the BERT part and training the BiLSTM-CRF part -> fine-tuning the whole network with a small learning rate

因为有看到测试的时候似乎用用原BERT的representation 的