Open AbdullahRJafar opened 3 years ago
Hi @AbdullahRJafar,
computeStatistics
function seems functionally identical (which is expected since they both derive from the KITTI devkit). Can you please check if you are using the same test set in both cases? It seems like their code evaluates all the images found in result_dir
, whereas this one expects a txt file containing the particular set of images used for evaluation. Maybe they are not identical, which will explain the difference.
Hey, I'm not sure how to get the alpha value of predictions so I just set it to 0, will this effect the evaluation?
Also I get a pretty good AP even though I thought I had a bunch of false detections. Although many of those false detections had a low confidence score. I think it doesn't count false detections when they confidence is low but I am not sure, hoping you can shine some light on that for me.
Lastly, I get something like 20% higher AP on this kitti eval, than I do on https://github.com/asharakeh/kitti_native_evaluation this one. They both look just like the one from the kitti website so I'm not sure what the difference would be. idk if you got any ideas about the last thing I mentioned.