Hi author, thanks for posting the code! I was able to prepare the dataset smoothly, but during evaluation with your checkpoint, a lot of warning showed. I am wondering what is the possible cause. Also it seems that the checkpoint does not match with the model.
(maptr) adminz@02-1390K-4090-64:~/Desktop/project/MapTR$ python -m torch.distributed.launch --nproc_per_node=1 --master_port=2333 tools/test.py projects/configs/maptr/maptr_tiny_r50_24e.py maptr_tiny_r50_24e.pth --launcher pytorch --eval chamfer
/home/adminz/anaconda3/envs/maptr/lib/python3.8/site-packages/torch/distributed/launch.py:178: FutureWarning: The module torch.distributed.launch is deprecated
and will be removed in future. Use torch.distributed.run.
Note that --use_env is set by default in torch.distributed.run.
If your script expects --local_rank argument to be set, please
change it to read from os.environ['LOCAL_RANK'] instead. See
https://pytorch.org/docs/stable/distributed.html#launch-utility for
further instructions
warnings.warn(
projects.mmdet3d_plugin
/home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/bevformer/modules/custom_base_transformer_layer.py:94: UserWarning: The arguments feedforward_channels in BaseTransformerLayer has been deprecated, now you should set feedforward_channels and other FFN related arguments to a dict named ffn_cfgs.
warnings.warn(
/home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/bevformer/modules/custom_base_transformer_layer.py:94: UserWarning: The arguments ffn_dropout in BaseTransformerLayer has been deprecated, now you should set ffn_drop and other FFN related arguments to a dict named ffn_cfgs.
warnings.warn(
/home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/bevformer/modules/custom_base_transformer_layer.py:94: UserWarning: The arguments ffn_num_fcs in BaseTransformerLayer has been deprecated, now you should set num_fcs and other FFN related arguments to a dict named ffn_cfgs.
warnings.warn(
/home/adminz/anaconda3/envs/maptr/lib/python3.8/site-packages/mmcv/cnn/bricks/transformer.py:341: UserWarning: The arguments feedforward_channels in BaseTransformerLayer has been deprecated, now you should set feedforward_channels and other FFN related arguments to a dict named ffn_cfgs.
warnings.warn(
/home/adminz/anaconda3/envs/maptr/lib/python3.8/site-packages/mmcv/cnn/bricks/transformer.py:341: UserWarning: The arguments ffn_dropout in BaseTransformerLayer has been deprecated, now you should set ffn_drop and other FFN related arguments to a dict named ffn_cfgs.
warnings.warn(
/home/adminz/anaconda3/envs/maptr/lib/python3.8/site-packages/mmcv/cnn/bricks/transformer.py:341: UserWarning: The arguments ffn_num_fcs in BaseTransformerLayer has been deprecated, now you should set num_fcs and other FFN related arguments to a dict named ffn_cfgs.
warnings.warn(
/home/adminz/anaconda3/envs/maptr/lib/python3.8/site-packages/mmcv/cnn/bricks/transformer.py:92: UserWarning: The arguments dropout in MultiheadAttention has been deprecated, now you can separately set attn_drop(float), proj_drop(float), and dropout_layer(dict)
warnings.warn('The arguments dropout in MultiheadAttention '
load checkpoint from local path: maptr_tiny_r50_24e.pth
The model and loaded state dict do not match exactly
unexpected key in source state_dict: pts_bbox_head.transformer.encoder.layers.0.attentions.1.attention.grid_offsets
[ ] 0/81, elapsed: 0s, ETA:/home/adminz/anaconda3/envs/maptr/lib/python3.8/site-packages/torch/_tensor.py:575: UserWarning: floor_divide is deprecated, and will be removed in a future version of pytorch. It currently rounds toward 0 (like the 'trunc' function NOT 'floor'). This results in incorrect rounding for negative values.
To keep the current behavior, use torch.div(a, b, rounding_mode='trunc'), or for actual floor division, use torch.div(a, b, rounding_mode='floor'). (Triggered internally at ../aten/src/ATen/native/BinaryOps.cpp:467.)
return torch.floor_divide(self, other)
[ ] 1/81, 0.4 task/s, elapsed: 2s, ETA: 188s/home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/core/bbox/coders/nms_free_coder.py:236: UserWarning: To copy construct from a tensor, it is recommended to use sourceTensor.clone().detach() or sourceTensor.clone().detach().requiresgrad(True), rather than torch.tensor(sourceTensor).
self.post_center_range = torch.tensor(
[>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>] 81/81, 4.7 task/s, elapsed: 17s, ETA: 0s
Formating bboxes of pts_bbox
Start to convert map detection format...
[>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>] 81/81, 23335.3 task/s, elapsed: 0s, ETA: 0s
/home/adminz/data/nuScenes/nuscenes_map_anns_val.json exist, not update
Results writes to test/maptr_tiny_r50_24e/Wed_Jul__5_14_54_32_2023/pts_bbox/nuscmap_results.json
Evaluating bboxes of pts_bbox
Formating results & gts by classes
results path: /home/adminz/Desktop/project/MapTR/test/maptr_tiny_r50_24e/Wed_Jul5_14_54_32_2023/pts_bbox/nuscmap_results.json
Formatting ...
Cls data formatting done in 1.214311s!! with /home/adminz/Desktop/project/MapTR/test/maptr_tiny_r50_24e/Wed_Jul5_14_54_32_2023/pts_bbox/cls_formatted.pkl
----------use metric:chamfer----------
----------threshhold:0.5----------
/home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2.
tree = STRtree(pred_lines_shapely)
/home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2.
tree = STRtree(pred_lines_shapely)
/home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2.
tree = STRtree(pred_lines_shapely)
/home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2.
tree = STRtree(pred_lines_shapely)
/home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2.
tree = STRtree(pred_lines_shapely)
/home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2.
tree = STRtree(pred_lines_shapely)
/home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2.
tree = STRtree(pred_lines_shapely)
/home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2.
tree = STRtree(pred_lines_shapely)
/home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2.
tree = STRtree(pred_lines_shapely)
/home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2.
tree = STRtree(pred_lines_shapely)
/home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2.
tree = STRtree(pred_lines_shapely)
/home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2.
tree = STRtree(pred_lines_shapely)
/home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2.
tree = STRtree(pred_lines_shapely)
/home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2.
tree = STRtree(pred_lines_shapely)
/home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2.
tree = STRtree(pred_lines_shapely)
/home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2.
tree = STRtree(pred_lines_shapely)
/home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2.
tree = STRtree(pred_lines_shapely)
/home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2.
tree = STRtree(pred_lines_shapely)
/home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2.
tree = STRtree(pred_lines_shapely)
/home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2.
tree = STRtree(pred_lines_shapely)
/home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2.
tree = STRtree(pred_lines_shapely)
/home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2.
tree = STRtree(pred_lines_shapely)
/home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2.
tree = STRtree(pred_lines_shapely)
/home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2.
tree = STRtree(pred_lines_shapely)
cls:divider done in 0.706216s!!
cls:ped_crossing done in 0.021080s!!
cls:boundary done in 0.053719s!!
+--------------+-----+------+--------+-------+
| class | gts | dets | recall | ap |
+--------------+-----+------+--------+-------+
| divider | 465 | 1809 | 0.744 | 0.639 |
| ped_crossing | 76 | 429 | 0.618 | 0.487 |
| boundary | 287 | 1812 | 0.331 | 0.165 |
+--------------+-----+------+--------+-------+
| mAP | | | | 0.430 |
+--------------+-----+------+--------+-------+
----------threshhold:1.0----------
/home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2.
tree = STRtree(pred_lines_shapely)
/home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2.
tree = STRtree(pred_lines_shapely)
/home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2.
tree = STRtree(pred_lines_shapely)
/home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2.
tree = STRtree(pred_lines_shapely)
/home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2.
tree = STRtree(pred_lines_shapely)
/home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2.
tree = STRtree(pred_lines_shapely)
/home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2.
tree = STRtree(pred_lines_shapely)
/home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2.
tree = STRtree(pred_lines_shapely)
/home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2.
tree = STRtree(pred_lines_shapely)
/home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2.
tree = STRtree(pred_lines_shapely)
/home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2.
tree = STRtree(pred_lines_shapely)
/home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2.
tree = STRtree(pred_lines_shapely)
/home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2.
tree = STRtree(pred_lines_shapely)
/home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2.
tree = STRtree(pred_lines_shapely)
/home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2.
tree = STRtree(pred_lines_shapely)
/home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2.
tree = STRtree(pred_lines_shapely)
/home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2.
tree = STRtree(pred_lines_shapely)
/home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2.
tree = STRtree(pred_lines_shapely)
/home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2.
tree = STRtree(pred_lines_shapely)
/home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2.
tree = STRtree(pred_lines_shapely)
/home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2.
tree = STRtree(pred_lines_shapely)
/home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2.
tree = STRtree(pred_lines_shapely)
/home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2.
tree = STRtree(pred_lines_shapely)
/home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2.
tree = STRtree(pred_lines_shapely)
cls:divider done in 0.708957s!!
cls:ped_crossing done in 0.020948s!!
cls:boundary done in 0.053411s!!
+--------------+-----+------+--------+-------+
| class | gts | dets | recall | ap |
+--------------+-----+------+--------+-------+
| divider | 465 | 1809 | 0.923 | 0.873 |
| ped_crossing | 76 | 429 | 0.974 | 0.948 |
| boundary | 287 | 1812 | 0.728 | 0.639 |
+--------------+-----+------+--------+-------+
| mAP | | | | 0.820 |
+--------------+-----+------+--------+-------+
----------threshhold:1.5----------
/home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2.
tree = STRtree(pred_lines_shapely)
/home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2.
tree = STRtree(pred_lines_shapely)
/home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2.
tree = STRtree(pred_lines_shapely)
/home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2.
tree = STRtree(pred_lines_shapely)
/home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2.
tree = STRtree(pred_lines_shapely)
/home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2.
tree = STRtree(pred_lines_shapely)
/home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2.
tree = STRtree(pred_lines_shapely)
/home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2.
tree = STRtree(pred_lines_shapely)
/home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2.
tree = STRtree(pred_lines_shapely)
/home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2.
tree = STRtree(pred_lines_shapely)
/home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2.
tree = STRtree(pred_lines_shapely)
/home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2.
tree = STRtree(pred_lines_shapely)
/home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2.
tree = STRtree(pred_lines_shapely)
/home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2.
tree = STRtree(pred_lines_shapely)
/home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2.
tree = STRtree(pred_lines_shapely)
/home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2.
tree = STRtree(pred_lines_shapely)
/home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2.
tree = STRtree(pred_lines_shapely)
/home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2.
tree = STRtree(pred_lines_shapely)
/home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2.
tree = STRtree(pred_lines_shapely)
/home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2.
tree = STRtree(pred_lines_shapely)
/home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2.
tree = STRtree(pred_lines_shapely)
/home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2.
tree = STRtree(pred_lines_shapely)
/home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2.
tree = STRtree(pred_lines_shapely)
/home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2.
tree = STRtree(pred_lines_shapely)
cls:divider done in 0.706770s!!
cls:ped_crossing done in 0.016796s!!
cls:boundary done in 0.053627s!!
Hi author, thanks for posting the code! I was able to prepare the dataset smoothly, but during evaluation with your checkpoint, a lot of warning showed. I am wondering what is the possible cause. Also it seems that the checkpoint does not match with the model.
(maptr) adminz@02-1390K-4090-64:~/Desktop/project/MapTR$ python -m torch.distributed.launch --nproc_per_node=1 --master_port=2333 tools/test.py projects/configs/maptr/maptr_tiny_r50_24e.py maptr_tiny_r50_24e.pth --launcher pytorch --eval chamfer /home/adminz/anaconda3/envs/maptr/lib/python3.8/site-packages/torch/distributed/launch.py:178: FutureWarning: The module torch.distributed.launch is deprecated and will be removed in future. Use torch.distributed.run. Note that --use_env is set by default in torch.distributed.run. If your script expects
--local_rank
argument to be set, please change it to read fromos.environ['LOCAL_RANK']
instead. See https://pytorch.org/docs/stable/distributed.html#launch-utility for further instructionswarnings.warn( projects.mmdet3d_plugin /home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/bevformer/modules/custom_base_transformer_layer.py:94: UserWarning: The arguments
feedforward_channels
in BaseTransformerLayer has been deprecated, now you should setfeedforward_channels
and other FFN related arguments to a dict namedffn_cfgs
. warnings.warn( /home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/bevformer/modules/custom_base_transformer_layer.py:94: UserWarning: The argumentsffn_dropout
in BaseTransformerLayer has been deprecated, now you should setffn_drop
and other FFN related arguments to a dict namedffn_cfgs
. warnings.warn( /home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/bevformer/modules/custom_base_transformer_layer.py:94: UserWarning: The argumentsffn_num_fcs
in BaseTransformerLayer has been deprecated, now you should setnum_fcs
and other FFN related arguments to a dict namedffn_cfgs
. warnings.warn( /home/adminz/anaconda3/envs/maptr/lib/python3.8/site-packages/mmcv/cnn/bricks/transformer.py:341: UserWarning: The argumentsfeedforward_channels
in BaseTransformerLayer has been deprecated, now you should setfeedforward_channels
and other FFN related arguments to a dict namedffn_cfgs
. warnings.warn( /home/adminz/anaconda3/envs/maptr/lib/python3.8/site-packages/mmcv/cnn/bricks/transformer.py:341: UserWarning: The argumentsffn_dropout
in BaseTransformerLayer has been deprecated, now you should setffn_drop
and other FFN related arguments to a dict namedffn_cfgs
. warnings.warn( /home/adminz/anaconda3/envs/maptr/lib/python3.8/site-packages/mmcv/cnn/bricks/transformer.py:341: UserWarning: The argumentsffn_num_fcs
in BaseTransformerLayer has been deprecated, now you should setnum_fcs
and other FFN related arguments to a dict namedffn_cfgs
. warnings.warn( /home/adminz/anaconda3/envs/maptr/lib/python3.8/site-packages/mmcv/cnn/bricks/transformer.py:92: UserWarning: The argumentsdropout
in MultiheadAttention has been deprecated, now you can separately setattn_drop
(float), proj_drop(float), anddropout_layer
(dict) warnings.warn('The argumentsdropout
in MultiheadAttention ' load checkpoint from local path: maptr_tiny_r50_24e.pth The model and loaded state dict do not match exactlyunexpected key in source state_dict: pts_bbox_head.transformer.encoder.layers.0.attentions.1.attention.grid_offsets
[ ] 0/81, elapsed: 0s, ETA:/home/adminz/anaconda3/envs/maptr/lib/python3.8/site-packages/torch/_tensor.py:575: UserWarning: floor_divide is deprecated, and will be removed in a future version of pytorch. It currently rounds toward 0 (like the 'trunc' function NOT 'floor'). This results in incorrect rounding for negative values. To keep the current behavior, use torch.div(a, b, rounding_mode='trunc'), or for actual floor division, use torch.div(a, b, rounding_mode='floor'). (Triggered internally at ../aten/src/ATen/native/BinaryOps.cpp:467.) return torch.floor_divide(self, other) [ ] 1/81, 0.4 task/s, elapsed: 2s, ETA: 188s/home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/core/bbox/coders/nms_free_coder.py:236: UserWarning: To copy construct from a tensor, it is recommended to use sourceTensor.clone().detach() or sourceTensor.clone().detach().requiresgrad(True), rather than torch.tensor(sourceTensor). self.post_center_range = torch.tensor( [>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>] 81/81, 4.7 task/s, elapsed: 17s, ETA: 0s Formating bboxes of pts_bbox Start to convert map detection format... [>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>] 81/81, 23335.3 task/s, elapsed: 0s, ETA: 0s /home/adminz/data/nuScenes/nuscenes_map_anns_val.json exist, not update Results writes to test/maptr_tiny_r50_24e/Wed_Jul__5_14_54_32_2023/pts_bbox/nuscmap_results.json Evaluating bboxes of pts_bbox Formating results & gts by classes results path: /home/adminz/Desktop/project/MapTR/test/maptr_tiny_r50_24e/Wed_Jul5_14_54_32_2023/pts_bbox/nuscmap_results.json Formatting ... Cls data formatting done in 1.214311s!! with /home/adminz/Desktop/project/MapTR/test/maptr_tiny_r50_24e/Wed_Jul5_14_54_32_2023/pts_bbox/cls_formatted.pkl ----------use metric:chamfer---------- ----------threshhold:0.5---------- /home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2. tree = STRtree(pred_lines_shapely) /home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2. tree = STRtree(pred_lines_shapely) /home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2. tree = STRtree(pred_lines_shapely) /home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2. tree = STRtree(pred_lines_shapely) /home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2. tree = STRtree(pred_lines_shapely) /home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2. tree = STRtree(pred_lines_shapely) /home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2. tree = STRtree(pred_lines_shapely) /home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2. tree = STRtree(pred_lines_shapely) /home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2. tree = STRtree(pred_lines_shapely) /home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2. tree = STRtree(pred_lines_shapely) /home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2. tree = STRtree(pred_lines_shapely) /home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2. tree = STRtree(pred_lines_shapely) /home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2. tree = STRtree(pred_lines_shapely) /home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2. tree = STRtree(pred_lines_shapely) /home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2. tree = STRtree(pred_lines_shapely) /home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2. tree = STRtree(pred_lines_shapely) /home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2. tree = STRtree(pred_lines_shapely) /home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2. tree = STRtree(pred_lines_shapely) /home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2. tree = STRtree(pred_lines_shapely) /home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2. tree = STRtree(pred_lines_shapely) /home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2. tree = STRtree(pred_lines_shapely) /home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2. tree = STRtree(pred_lines_shapely) /home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2. tree = STRtree(pred_lines_shapely) /home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2. tree = STRtree(pred_lines_shapely) cls:divider done in 0.706216s!! cls:ped_crossing done in 0.021080s!! cls:boundary done in 0.053719s!!
+--------------+-----+------+--------+-------+ | class | gts | dets | recall | ap | +--------------+-----+------+--------+-------+ | divider | 465 | 1809 | 0.744 | 0.639 | | ped_crossing | 76 | 429 | 0.618 | 0.487 | | boundary | 287 | 1812 | 0.331 | 0.165 | +--------------+-----+------+--------+-------+ | mAP | | | | 0.430 | +--------------+-----+------+--------+-------+ ----------threshhold:1.0---------- /home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2. tree = STRtree(pred_lines_shapely) /home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2. tree = STRtree(pred_lines_shapely) /home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2. tree = STRtree(pred_lines_shapely) /home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2. tree = STRtree(pred_lines_shapely) /home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2. tree = STRtree(pred_lines_shapely) /home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2. tree = STRtree(pred_lines_shapely) /home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2. tree = STRtree(pred_lines_shapely) /home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2. tree = STRtree(pred_lines_shapely) /home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2. tree = STRtree(pred_lines_shapely) /home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2. tree = STRtree(pred_lines_shapely) /home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2. tree = STRtree(pred_lines_shapely) /home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2. tree = STRtree(pred_lines_shapely) /home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2. tree = STRtree(pred_lines_shapely) /home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2. tree = STRtree(pred_lines_shapely) /home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2. tree = STRtree(pred_lines_shapely) /home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2. tree = STRtree(pred_lines_shapely) /home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2. tree = STRtree(pred_lines_shapely) /home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2. tree = STRtree(pred_lines_shapely) /home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2. tree = STRtree(pred_lines_shapely) /home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2. tree = STRtree(pred_lines_shapely) /home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2. tree = STRtree(pred_lines_shapely) /home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2. tree = STRtree(pred_lines_shapely) /home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2. tree = STRtree(pred_lines_shapely) /home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2. tree = STRtree(pred_lines_shapely) cls:divider done in 0.708957s!! cls:ped_crossing done in 0.020948s!! cls:boundary done in 0.053411s!!
+--------------+-----+------+--------+-------+ | class | gts | dets | recall | ap | +--------------+-----+------+--------+-------+ | divider | 465 | 1809 | 0.923 | 0.873 | | ped_crossing | 76 | 429 | 0.974 | 0.948 | | boundary | 287 | 1812 | 0.728 | 0.639 | +--------------+-----+------+--------+-------+ | mAP | | | | 0.820 | +--------------+-----+------+--------+-------+ ----------threshhold:1.5---------- /home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2. tree = STRtree(pred_lines_shapely) /home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2. tree = STRtree(pred_lines_shapely) /home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2. tree = STRtree(pred_lines_shapely) /home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2. tree = STRtree(pred_lines_shapely) /home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2. tree = STRtree(pred_lines_shapely) /home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2. tree = STRtree(pred_lines_shapely) /home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2. tree = STRtree(pred_lines_shapely) /home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2. tree = STRtree(pred_lines_shapely) /home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2. tree = STRtree(pred_lines_shapely) /home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2. tree = STRtree(pred_lines_shapely) /home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2. tree = STRtree(pred_lines_shapely) /home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2. tree = STRtree(pred_lines_shapely) /home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2. tree = STRtree(pred_lines_shapely) /home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2. tree = STRtree(pred_lines_shapely) /home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2. tree = STRtree(pred_lines_shapely) /home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2. tree = STRtree(pred_lines_shapely) /home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2. tree = STRtree(pred_lines_shapely) /home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2. tree = STRtree(pred_lines_shapely) /home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2. tree = STRtree(pred_lines_shapely) /home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2. tree = STRtree(pred_lines_shapely) /home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2. tree = STRtree(pred_lines_shapely) /home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2. tree = STRtree(pred_lines_shapely) /home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2. tree = STRtree(pred_lines_shapely) /home/adminz/Desktop/project/MapTR/projects/mmdet3d_plugin/datasets/map_utils/tpfp_chamfer.py:35: ShapelyDeprecationWarning: STRtree will be changed in 2.0.0 and will not be compatible with versions < 2. tree = STRtree(pred_lines_shapely) cls:divider done in 0.706770s!! cls:ped_crossing done in 0.016796s!! cls:boundary done in 0.053627s!!
+--------------+-----+------+--------+-------+ | class | gts | dets | recall | ap | +--------------+-----+------+--------+-------+ | divider | 465 | 1809 | 0.957 | 0.926 | | ped_crossing | 76 | 429 | 1.000 | 0.980 | | boundary | 287 | 1812 | 0.850 | 0.760 | +--------------+-----+------+--------+-------+ | mAP | | | | 0.889 | +--------------+-----+------+--------+-------+ divider: 0.8124819000562032 ped_crossing: 0.8049570620059967 boundary: 0.5212676574786504 map: 0.7129022065136169 {'NuscMap_chamfer/divider_AP': 0.8124819000562032, 'NuscMap_chamfer/ped_crossing_AP': 0.8049570620059967, 'NuscMap_chamfer/boundary_AP': 0.5212676574786504, 'NuscMap_chamfer/mAP': 0.7129022065136169, 'NuscMap_chamfer/divider_AP_thr_0.5': 0.6389297842979431, 'NuscMap_chamfer/divider_AP_thr_1.0': 0.8725837469100952, 'NuscMap_chamfer/divider_AP_thr_1.5': 0.9259321689605713, 'NuscMap_chamfer/ped_crossing_AP_thr_0.5': 0.4865259826183319, 'NuscMap_chamfer/ped_crossing_AP_thr_1.0': 0.9480955004692078, 'NuscMap_chamfer/ped_crossing_AP_thr_1.5': 0.9802497029304504, 'NuscMap_chamfer/boundary_AP_thr_0.5': 0.16540159285068512, 'NuscMap_chamfer/boundary_AP_thr_1.0': 0.6387144327163696, 'NuscMap_chamfer/boundary_AP_thr_1.5': 0.7596869468688965}