search

cguindel / eval_kitti

Tools to evaluate object detection results using the KITTI dataset.
57 stars 23 forks source link

Recall Discretization failed. 0 thresholds found #19

Closed shashankvasisht closed 3 years ago

shashankvasisht commented 3 years ago

Any ideas where i might be going wrong ?

Starting evaluation...
Results list: ../lists/test_4.txt
mkdir: cannot create directory ‘results/smoke_nusc_only1600x960/plot’: File exists
Getting valid images...
File loaded
Loading detections...
-----------
GT STATS
-----------
Vehicle : 30251
Cyclist : 596
Pedestrian : 8670
-----------
DET STATS
-----------
Vehicle : 21786
Cyclist : 218
Pedestrian : 4699
  done.
Vehicle: Starting 2D evaluation (Easy/Moderate/Hard)...
Getting detection scores to compute thresholds
Evaluating on 25609 valid ground-truth instances and 17238 valid detections
Computing statistics
Stats computed
Getting detection scores to compute thresholds
Evaluating on 29694 valid ground-truth instances and 21305 valid detections
Computing statistics
Stats computed
Getting detection scores to compute thresholds
Evaluating on 29694 valid ground-truth instances and 21305 valid detections
Computing statistics
Stats computed
Saving results/smoke_nusc_only1600x960/plot/Vehicle_detection.txt
-----------
Vehicle_detection AP (%): 0.82 / 0.68 / 0.68
-----------
sh: 1: gnuplot: not found
sh: 1: gnuplot: not found
Error: /undefinedfilename in (Vehicle_detection.eps)
Operand stack:

Execution stack:
   %interp_exit   .runexec2   --nostringval--   --nostringval--   --nostringval--   2   %stopped_push   --nostringval--   --nostringval--   --nostringval--   false   1   %stopped_push
Dictionary stack:
   --dict:960/1684(ro)(G)--   --dict:0/20(G)--   --dict:77/200(L)--
Current allocation mode is local
Last OS error: No such file or directory
GPL Ghostscript 9.26: Unrecoverable error, exit code 1
sh: 1: pdfcrop: not found
Saving results/smoke_nusc_only1600x960/plot/Vehicle_orientation.txt
-----------
Vehicle_orientation AOS (%): 0.78 / 0.65 / 0.65
-----------
sh: 1: gnuplot: not found
sh: 1: gnuplot: not found
Error: /undefinedfilename in (Vehicle_orientation.eps)
Operand stack:

Execution stack:
   %interp_exit   .runexec2   --nostringval--   --nostringval--   --nostringval--   2   %stopped_push   --nostringval--   --nostringval--   --nostringval--   false   1   %stopped_push
Dictionary stack:
   --dict:960/1684(ro)(G)--   --dict:0/20(G)--   --dict:77/200(L)--
Current allocation mode is local
Last OS error: No such file or directory
GPL Ghostscript 9.26: Unrecoverable error, exit code 1
sh: 1: pdfcrop: not found
Saving results/smoke_nusc_only1600x960/plot/Vehicle_mppe.txt
sh: 1: gnuplot: not found
sh: 1: gnuplot: not found
Error: /undefinedfilename in (Vehicle_mppe.eps)
Operand stack:

Execution stack:
   %interp_exit   .runexec2   --nostringval--   --nostringval--   --nostringval--   2   %stopped_push   --nostringval--   --nostringval--   --nostringval--   false   1   %stopped_push
Dictionary stack:
   --dict:960/1684(ro)(G)--   --dict:0/20(G)--   --dict:77/200(L)--
Current allocation mode is local
Last OS error: No such file or directory
GPL Ghostscript 9.26: Unrecoverable error, exit code 1
sh: 1: pdfcrop: not found
Cyclist: Starting 2D evaluation (Easy/Moderate/Hard)...
Getting detection scores to compute thresholds
Evaluating on 536 valid ground-truth instances and 188 valid detections
Computing statistics
Recall discretization failed. 0 thresholds found
Cyclist evaluation failed.
Something happened...
cguindel commented 3 years ago

I think you can come across this error when there are 0 true positives in your results. I have just uploaded 83c4c9e, which prints the TP/FP/FN stats for each category. Could you please give it a try?