When I set "strict" "True" in load_state_dict, I find errors "Unexpected key(s) in state_dict:...". Because in "pointer.model.encoder.layers.0.sublayer.0.norm", there are redundant parameters.
for example:
44 pointer.model.encoder.layers.0.sublayer.0.norm.norm.weight
45 pointer.model.encoder.layers.0.sublayer.0.norm.norm.bias
46 pointer.model.encoder.layers.0.sublayer.0.norm.norm.running_mean
47 pointer.model.encoder.layers.0.sublayer.0.norm.norm.running_var
48 pointer.model.encoder.layers.0.sublayer.0.norm.norm.num_batches_tracked
When I set "strict" "True" in load_state_dict, I find errors "Unexpected key(s) in state_dict:...". Because in "pointer.model.encoder.layers.0.sublayer.0.norm", there are redundant parameters. for example: 44 pointer.model.encoder.layers.0.sublayer.0.norm.norm.weight 45 pointer.model.encoder.layers.0.sublayer.0.norm.norm.bias 46 pointer.model.encoder.layers.0.sublayer.0.norm.norm.running_mean 47 pointer.model.encoder.layers.0.sublayer.0.norm.norm.running_var 48 pointer.model.encoder.layers.0.sublayer.0.norm.norm.num_batches_tracked