TRAILab / PDV

Point Density-Aware Voxels for LiDAR 3D Object Detection (CVPR 2022)
Apache License 2.0
158 stars 29 forks source link

About full validation results on the uploaded PDV weights #14

Closed quotation2520 closed 1 year ago

quotation2520 commented 1 year ago

Hi, nice work, and thank you for sharing the code and a trained checkpoint.

Despite your kind walkthrough, I'm having difficulties running your code with the given model-147M weights. I had some version issues regarding spconv, pytorch, and pcdet. Then I encountered some parameter load failure problems. (I was able to train the model from scratch.)

Can you inform me full evaluation results I could achieve when I run your model? Sharing your evaluation log (as below) would be more than sufficient.

INFO  Generate label finished(sec_per_example: 0.0109 second).
INFO  recall_roi_0.3: xxxxxxx
INFO  recall_rcnn_0.3: xxxxxxx
INFO  recall_roi_0.5: xxxxxxx
INFO  recall_rcnn_0.5: xxxxxxx
INFO  recall_roi_0.7: xxxxxxx
INFO  recall_rcnn_0.7: xxxxxxx
INFO  Average predicted number of objects(3769 samples): xxxxxxx
INFO  Car AP@0.70, 0.70, 0.70:
bbox AP:xxxxxxx, xxxxxxx, xxxxxxx
bev  AP:xxxxxxx, xxxxxxx, xxxxxxx
3d   AP:xxxxxxx, xxxxxxx, xxxxxxx
aos  AP:xxxxxxx, xxxxxxx, xxxxxxx
Car AP_R40@0.70, 0.70, 0.70:
bbox AP:xxxxxxx, xxxxxxx, xxxxxxx
bev  AP:xxxxxxx, xxxxxxx, xxxxxxx
3d   AP:xxxxxxx, 85.05, xxxxxxx
aos  AP:xxxxxxx, xxxxxxx, xxxxxxx
.
.
.

Thank you!

quotation2520 commented 1 year ago

Nevermind, I've got the results!

For anyone who's interested, here's the 3D AP@R40 of three classes

Easy Moderate Hard
CAR 92.44 85.05 82.77
PEDESTRIAN 63.89 57.40 52.56
CYCLIST 91.78 75.95 71.36