Training v2vnet got the wrong result

[rujiawang329]

I have trained v2vnet for 60 epochs. However, when I test the last epoch results, I get that all IOU is 0.

The output of the result is in the below picture.

Here is some background information about my training.

First, about the environment, spconv is spconv-cu113 2.3.6, pytorch is 1.11.0+cu113. The more detailed environment information is in the bellow picture.

Next, about the training and inference code. I use python opencood/tools/train.py --hypes_yaml opencood/hypes_yaml/point_pillar_v2vnet.yaml for train. I use python opencood/tools/inference.py --model_dir opencood/logs/point_pillar_v2vnet_2023_06_05_06_40_58/ --fusion_method intermediate for test.

Last, the training loss can be seen in the below picture.

Thanks a lot for helping me to solve this problem.

[DerrickXuNu]

V2VNet is hard to train, sometime you need some luck to have good weight initialization you train to coverage. I suggest directly using the checkpoint that I provide as a start point.

[rujiawang329]

OK, thanks!