open-mmlab / mmdetection3d

OpenMMLab's next-generation platform for general 3D object detection.
https://mmdetection3d.readthedocs.io/en/latest/
Apache License 2.0
5.18k stars 1.52k forks source link

Unable to test votenet pretrained model #145

Closed filaPro closed 3 years ago

filaPro commented 3 years ago

Looks like the state dict of current master votenet is not compatible with given pretrained checkpoints.

The model and loaded state dict do not match exactly

unexpected key in source state_dict: bbox_head.conv_pred.0.conv.weight, bbox_head.conv_pred.0.conv.bias, bbox_head.conv_pred.0.bn.weight, bbox_head.conv_pred.0.bn.bias, bbox_head.conv_pred.0.bn.running_mean, bbox_head.conv_pred.0.bn.running_var, bbox_head.conv_pred.0.bn.num_batches_tracked, bbox_head.conv_pred.1.conv.weight, bbox_head.conv_pred.1.conv.bias, bbox_head.conv_pred.1.bn.weight, bbox_head.conv_pred.1.bn.bias, bbox_head.conv_pred.1.bn.running_mean, bbox_head.conv_pred.1.bn.running_var, bbox_head.conv_pred.1.bn.num_batches_tracked, bbox_head.conv_pred.conv_out.weight, bbox_head.conv_pred.conv_out.bias

missing keys in source state_dict: bbox_head.conv_pred.shared_convs.layer0.conv.weight, bbox_head.conv_pred.shared_convs.layer0.bn.weight, bbox_head.conv_pred.shared_convs.layer0.bn.bias, bbox_head.conv_pred.shared_convs.layer0.bn.running_mean, bbox_head.conv_pred.shared_convs.layer0.bn.running_var, bbox_head.conv_pred.shared_convs.layer1.conv.weight, bbox_head.conv_pred.shared_convs.layer1.bn.weight, bbox_head.conv_pred.shared_convs.layer1.bn.bias, bbox_head.conv_pred.shared_convs.layer1.bn.running_mean, bbox_head.conv_pred.shared_convs.layer1.bn.running_var, bbox_head.conv_pred.conv_cls.weight, bbox_head.conv_pred.conv_cls.bias, bbox_head.conv_pred.conv_reg.weight, bbox_head.conv_pred.conv_reg.bias
ZwwWayne commented 3 years ago

There is a refactor on the votehead and we forget to convert the keys in the checkpoints. @encore-zhou will have a check and update a model upgrade script. This might take some time, so for a quick fix, you might need to convert the key names by yourself.

filaPro commented 3 years ago

There are 16 unexpected keys and 14 missing ones, so simple renaming is not going to help. Looking forward for update.

filaPro commented 3 years ago

If it helps, votenet model for sunrgbd compatible with mmdetection==0.6.0: epoch_36.pth, 20201008_113526.log.json. | AP_0.25 | AR_0.25 | AP_0.50 | AR_0.50 | | 0.6015 | 0.8696 | 0.3598 | 0.5367 |