hustvl / VAD

[ICCV 2023] VAD: Vectorized Scene Representation for Efficient Autonomous Driving
https://arxiv.org/abs/2303.12077
Apache License 2.0
694 stars 71 forks source link

Problem of reproduced results #41

Open JuiceLemonLemon opened 10 months ago

JuiceLemonLemon commented 10 months ago

Hello, Thank you for your great work!

Below is my reproduced results, I found _planL2 is the same with paper's, but the _plan_obj_boxcol is not, I don't konw why. Do you have some ideas?

-------------- Planning -------------- gt_car:4.503418636452432 gt_pedestrian:2.099042781793319 cnt_ade_car:3.428990037116624 cnt_ade_pedestrian:1.176596991599922 cnt_fde_car:3.2633326821644855 cnt_fde_pedestrian:1.0459074037898026 hit_car:2.867942957608908 hit_pedestrian:0.9474506739597578 fp_car:0.2959562414534089 fp_pedestrian:0.5661261965227583 ADE_car:2.7811522483825684 ADE_pedestrian:0.8981940746307373 FDE_car:3.508023500442505 FDE_pedestrian:0.9897515177726746 MR_car:0.39538972455557725 MR_pedestrian:0.09845672983004493 plan_L2_1s:0.4626927305850084 plan_L2_2s:0.7634323247307431 plan_L2_3s:1.1214187069235144 plan_obj_col_1s:0.0 plan_obj_col_2s:0.0 plan_obj_col_3s:0.0 plan_obj_box_col_1s:0.0010744285993358079 plan_obj_box_col_2s:0.002441883180308654 plan_obj_box_col_3s:0.004167480699530242 fut_valid_flag:1.0

rb93dett commented 10 months ago

Could you describe the model and the config file you use, as well as the evaluation command, so that I can help you find the problem?

yuyuyuyuyuty commented 5 months ago

Hello, I meet the same error. Have you solved it?

PeidongLi commented 5 months ago

CUDA_VISIBLE_DEVICES=0 python tools/test.py projects/configs/VAD/VAD_tiny_e2e.py VAD_tiny.pth --launcher none --eval bbox --tmpdir outputs same question when reproducing with this command, can you help to find the problem? @rb93dett

Could you describe the model and the config file you use, as well as the evaluation command, so that I can help you find the problem?

MRYUjg commented 2 months ago

I'm having the same issue. Pls have you solved it?