wzzheng / TPVFormer

An academic alternative to Tesla's occupancy network for autonomous driving.
https://wzzheng.net/TPVFormer/
Apache License 2.0
1.1k stars 102 forks source link

Missing keys while loading pre-trained FCOS-3D weights #58

Open amundra15 opened 8 months ago

amundra15 commented 8 months ago

While loading the pre-trained FCOS-3D weights for training, the code complains about incompatible keys.

Upon analyzing it, most of the "incompatible" keys are as expected (eg, tpv_aggregator, tpv_head related keys missing in the loaded model and bbox_head keys missing in the defined model).

However, one set of items still did not make sense to me. For the image_backbone (and possibly for image_neck) batch norm layers, the running_mean, running_var, and num_batches_tracked keys are present in the checkpoint, but not in my model definition. I am not sure if this is intended -- a quick Google search says that these parameters are critical for training and inference, even if the BN parameters are frozen.

Could you shed some light on this?