search

HuangJunJie2017 / BEVDet

Code base of the BEVDet series .
Apache License 2.0
1.45k stars 266 forks source link

The problem of inconsistency between the performance of github and the code you announced #289

Closed zhenghw111 closed 1 year ago

zhenghw111 commented 1 year ago

Hello author! Thanks for the great work you do! I found that the performance you announced on GitHub is not consistent with the performance in the code you provided. For example, BEVDet-R50-CBGS has mAP=31.3 on GitHub but only 30.85 in the code, BEVDet-R50-4D-CBGS+align mAP=35.4, but only 31.6 in the code. This doesn't seem reasonable, so what should I use as a criterion? image https://github.com/HuangJunJie2017/BEVDet/blob/dev2.1/configs/bevdet/bevdet-r50-cbgs.py https://github.com/HuangJunJie2017/BEVDet/blob/dev2.1/configs/bevdet/bevdet-r50-4d-cbgs.py

HuangJunJie2017 commented 1 year ago

@zhenghw111 use the performance listed in the config files

zhenghw111 commented 1 year ago

OK! Thank you for your reply.