请问训练的时候loss出现负值的情况是正确的吗

macanv / BERT-BiLSTM-CRF-NER

Tensorflow solution of NER task Using BiLSTM-CRF model with Google BERT Fine-tuning And private Server services

https://github.com/macanv/BERT-BiLSMT-CRF-NER

4.69k stars 1.25k forks source link

请问训练的时候loss出现负值的情况是正确的吗 #273

Open CXXXXv opened 4 years ago

CXXXXv commented 4 years ago

20191127145000

macanv commented 4 years ago

没有出现过。。。请检查代码

CXXXXv commented 4 years ago

我把rst = blstm_crf.add_blstm_crf_layer(crf_only=True)这里改成了crf_only=False,其他的只改了train_helper里的一些参数，比如batch_size、output_dir这些，然后再运行了大概10个epochs左右就开始出现这种情况

Turbo-wang commented 4 years ago

如果是用自己构造的数据，建议检查一下标签。之前遇到过，标签有问题会出现这种情况