lyft / nuscenes-devkit

Devkit for the public 2019 Lyft Level 5 AV Dataset (fork of https://github.com/nutonomy/nuscenes-devkit)
Other
366 stars 103 forks source link

Bug in Intersection over Union calculations #47

Closed RustemIskuzhin closed 4 years ago

RustemIskuzhin commented 4 years ago

I find that predicting 3d boxes with increased lengths and widths (x100 from original) somehow change score from 0.233 to 0.408. I think it should bug in Intersection over Union calculations.

ternaus commented 4 years ago

Thank you! We will look into this.

ternaus commented 4 years ago

There was a bug in the metric implementation at Kaggle. Was fixed. Everything should be fine now.