ps:
WARNING:tensorflow:Unused attribute in object (root).body.bert.embedding_layer.token_type_embeddings: ['VARIABLE_VALUE']
WARNING:tensorflow:Unused attribute in object (root).body.bert.embedding_layer.embeddings: ['VARIABLE_VALUE']
WARNING:tensorflow:A checkpoint was restored (e.g. tf.train.Checkpoint.restore or tf.keras.Model.load_weights) but not all checkpointed values were used. See above for specific issues. Use expect_partial() on the load status object, e.g. tf.train.Checkpoint.restore(...).expect_partial(), to silence these warnings, or use assert_consumed() to make the check explicit. See https://www.tensorflow.org/guide/checkpoint#loading_mechanics for details.
预测值不固定,发现embedding层没有加载问题。(好像之前也有遇到过?后贴图)
ps: WARNING:tensorflow:Unused attribute in object (root).body.bert.embedding_layer.token_type_embeddings: ['VARIABLE_VALUE'] WARNING:tensorflow:Unused attribute in object (root).body.bert.embedding_layer.embeddings: ['VARIABLE_VALUE'] WARNING:tensorflow:A checkpoint was restored (e.g. tf.train.Checkpoint.restore or tf.keras.Model.load_weights) but not all checkpointed values were used. See above for specific issues. Use expect_partial() on the load status object, e.g. tf.train.Checkpoint.restore(...).expect_partial(), to silence these warnings, or use assert_consumed() to make the check explicit. See https://www.tensorflow.org/guide/checkpoint#loading_mechanics for details.