wangbo9719 / StAR_KGC

84 stars 10 forks source link

problem:11/20 10:40:54 AM: Weights from pretrained model not used in BertForPairCls: ['cls.predictions.bias', 'cls.predictions.transform.dense.weight', 'cls.predictions.transform.dense.bias', 'cls.predictions.decoder.weight', 'cls.seq_relationship.weight', 'cls.seq_relationship.bias', 'cls.predictions.transform.LayerNorm.weight', 'cls.predictions.transform.LayerNorm.bias'] #18

Open star-rui opened 11 months ago

star-rui commented 11 months ago

在运行get_new_dev_list.py时,控制台输出日志显示: 11/20 10:40:53 AM: loading file E:/project/StAR_KGC-master/StAR_KGC-master/bert-base-uncased/bert-base-uncased-vocab.txt 11/20 10:40:53 AM: loading weights file E:/project/StAR_KGC-master/StAR_KGC-master/bert-base-uncased/bert-base-uncased-pytorch_model.bin 11/20 10:40:54 AM: Weights of BertForPairCls not initialized from pretrained model: ['proj.weight', 'proj.bias'] 11/20 10:40:54 AM: Weights from pretrained model not used in BertForPairCls: ['cls.predictions.bias', 'cls.predictions.transform.dense.weight', 'cls.predictions.transform.dense.bias', 'cls.predictions.decoder.weight', 'cls.seq_relationship.weight', 'cls.seq_relationship.bias', 'cls.predictions.transform.LayerNorm.weight', 'cls.predictions.transform.LayerNorm.bias'] 权重没有被加载,请问这是正常的吗?

wangbo9719 commented 1 month ago

This is normal and will not affect the results.