cguindel / eval_kitti

Tools to evaluate object detection results using the KITTI dataset.
57 stars 23 forks source link

How to evaluate 'Pedestrian' and 'Cyclist' classes? #13

Closed yinggo closed 3 years ago

yinggo commented 3 years ago

Thanks for this good evaluation code. I meet some problem when I run the code.

./evaluate_object kitti_yolo_2x valsplit
Starting evaluation...
Results list: lists/valsplit.txt
mkdir: cannot create directory ‘results/kitti_yolo_2x/plot’: File exists
Getting valid images... 
File loaded
Loading detections... 
-----------
GT STATS
-----------
car : 3258
pedestrian : 503
cyclist : 166
van : 0
truck : 0
person_sitting : 0
tram : 0
-----------
DET STATS
-----------
car : 39907
pedestrian : 5700
cyclist : 2418
van : 0
truck : 0
person_sitting : 0
tram : 0
  done.
car: Starting 2D evaluation (Easy/Moderate/Hard)...
Getting detection scores to compute thresholds
Evaluating on 679 valid ground-truth instances and 19828 valid detections
Computing statistics
Stats computed 
Getting detection scores to compute thresholds
Evaluating on 1735 valid ground-truth instances and 31972 valid detections
Computing statistics
Stats computed 
Getting detection scores to compute thresholds
Evaluating on 2384 valid ground-truth instances and 31972 valid detections
Computing statistics
Stats computed 
Saving results/kitti_yolo_2x/plot/car_detection.txt
-----------
car_detection AP (%): 97.48 / 97.19 / 95.13
-----------
sh: 1: gnuplot: not found
sh: 1: gnuplot: not found
Error: /undefinedfilename in (car_detection.eps)
Operand stack:

Execution stack:
   %interp_exit   .runexec2   --nostringval--   --nostringval--   --nostringval--   2   %stopped_push   --nostringval--   --nostringval--   --nostringval--   false   1   %stopped_push
Dictionary stack:
   --dict:960/1684(ro)(G)--   --dict:0/20(G)--   --dict:77/200(L)--
Current allocation mode is local
Last OS error: No such file or directory
GPL Ghostscript 9.26: Unrecoverable error, exit code 1
sh: 1: pdfcrop: not found
Found no pedestrian detections
Found no cyclist detections
No ground-truth samples of van found
No ground-truth samples of truck found
No ground-truth samples of person_sitting found
No ground-truth samples of tram found
Found no van ground-truth samples
Found no truck ground-truth samples
Found no person_sitting ground-truth samples
Found no tram ground-truth samples
Found no van ground-truth samples
Found no truck ground-truth samples
Found no person_sitting ground-truth samples
Found no tram ground-truth samples
Evaluation finished successfully

I only evaluate the 'Car', how could I evaluate the 'Pedestrian', and 'Cyclist' classes? The detection result .txt files include 'Pedestrian' and 'Cyclist' detections.

yinggo commented 3 years ago

solved. : )