songyouwei
commented
4 years ago Pre-trained BERT module is a submodule of your BERT-based model, so all the parameters are tuned together.
Open GW-S opened 4 years ago
songyouwei
commented
4 years ago Pre-trained BERT module is a submodule of your BERT-based model, so all the parameters are tuned together.
hello , In your paper ,we can see
BERT embedding uses the pre-trained BERT to generate word vectors of sequence. In order to facilitate the training and fine-tuning of BERT model, we transform the given context and target to “[CLS] + context + [SEP]” and “[CLS] + target + [SEP]” respectively.can you tell me ,how you fine-tuning BERT model? use BERT ML model?