トラッキングにおけるエラー No ground truth

[sakai5678]

TrainingのTrain ablation model (MOT17 half train and CrowdHuman)を行った後、TrackingのEvaluation on MOT17 half valの以下のコードを実行した際にエラーが発生しました。 解決法がわかる方がいましたら、教えていただきたいです。

[実行コード] python3 tools/track.py -f exps/example/mot/yolox_x_ablation.py -c pretrained/bytetrack_ablation.pth.tar -b 1 -d 1 --fp16 --fuse

[実行結果] 2024-06-04 07:46:46 | INFO | main:154 - Args: Namespace(batch_size=1, ckpt='pretrained/bytetrack_ablation.pth.tar', conf=0.01, devices=1, dist_backend='nccl', dist_url=None, exp_file='exps/example/mot/yolox_x_ablation.py', experiment_name='yolox_x_ablation', fp16=True, fuse=True, local_rank=0, machine_rank=0, match_thresh=0.9, min_box_area=100, mot20=False, name=None, nms=0.7, num_machines=1, opts=[], seed=None, speed=False, test=False, track_buffer=30, track_thresh=0.6, trt=False, tsize=None) 2024-06-04 07:46:46 | INFO | main:164 - Model Summary: Params: 99.00M, Gflops: 793.21 2024-06-04 07:46:46 | INFO | yolox.data.datasets.mot:39 - loading annotations into memory... 2024-06-04 07:46:47 | INFO | yolox.data.datasets.mot:39 - Done (t=0.23s) 2024-06-04 07:46:47 | INFO | pycocotools.coco:88 - creating index... 2024-06-04 07:46:47 | INFO | pycocotools.coco:88 - index created! 2024-06-04 07:46:51 | INFO | main:186 - loading checkpoint 2024-06-04 07:47:02 | INFO | main:191 - loaded checkpoint done. 2024-06-04 07:47:02 | INFO | main:197 - Fusing model... /usr/local/lib/python3.8/dist-packages/torch/nn/modules/module.py:561: UserWarning: The .grad attribute of a Tensor that is not a leaf Tensor is being accessed. Its .grad attribute won't be populated during autograd.backward(). If you indeed want the gradient for a non-leaf Tensor, use .retain_grad() on the non-leaf Tensor. If you access the non-leaf Tensor by mistake, make sure you access the leaf Tensor instead. See github.com/pytorch/pytorch/pull/30531 for more information. if param.grad is not None: 11%|#1 | 298/2652 [00:13<01:29, 26.39it/s]2024-06-04 07:47:16 | INFO | yolox.evaluators.mot_evaluator:39 - save results to ./YOLOX_outputs/yolox_x_ablation/track_results/MOT17-02-FRCNN.txt 31%|###1 | 823/2652 [00:34<01:11, 25.49it/s]2024-06-04 07:47:38 | INFO | yolox.evaluators.mot_evaluator:39 - save results to ./YOLOX_outputs/yolox_x_ablation/track_results/MOT17-04-FRCNN.txt 47%|####6 | 1240/2652 [00:49<00:50, 28.03it/s]2024-06-04 07:47:53 | INFO | yolox.evaluators.mot_evaluator:39 - save results to ./YOLOX_outputs/yolox_x_ablation/track_results/MOT17-05-FRCNN.txt 57%|#####6 | 1501/2652 [00:59<00:41, 28.06it/s]2024-06-04 07:48:02 | INFO | yolox.evaluators.mot_evaluator:39 - save results to ./YOLOX_outputs/yolox_x_ablation/track_results/MOT17-09-FRCNN.txt 69%|######8 | 1828/2652 [01:11<00:30, 27.12it/s]2024-06-04 07:48:14 | INFO | yolox.evaluators.mot_evaluator:39 - save results to ./YOLOX_outputs/yolox_x_ablation/track_results/MOT17-10-FRCNN.txt 86%|########5 | 2278/2652 [01:27<00:13, 28.21it/s]2024-06-04 07:48:30 | INFO | yolox.evaluators.mot_evaluator:39 - save results to ./YOLOX_outputs/yolox_x_ablation/track_results/MOT17-11-FRCNN.txt 100%|#########9| 2651/2652 [01:40<00:00, 29.50it/s]2024-06-04 07:48:43 | INFO | yolox.evaluators.mot_evaluator:39 - save results to ./YOLOX_outputs/yolox_x_ablation/track_results/MOT17-13-FRCNN.txt 100%|##########| 2652/2652 [01:41<00:00, 26.23it/s] 2024-06-04 07:48:43 | INFO | yolox.evaluators.mot_evaluator:630 - Evaluate in main process... 2024-06-04 07:48:44 | INFO | yolox.evaluators.mot_evaluator:659 - Loading and preparing results... 2024-06-04 07:48:45 | INFO | yolox.evaluators.mot_evaluator:659 - DONE (t=0.39s) 2024-06-04 07:48:45 | INFO | pycocotools.coco:363 - creating index... 2024-06-04 07:48:45 | INFO | pycocotools.coco:363 - index created! Running per image evaluation... Evaluate annotation type bbox COCOeval_opt.evaluate() finished in 0.71 seconds. Accumulating evaluation results... COCOeval_opt.accumulate() finished in 0.15 seconds. 2024-06-04 07:48:46 | INFO | main:218 - Average forward time: 32.23 ms, Average track time: 2.53 ms, Average inference time: 34.76 ms Average Precision (AP) @[ IoU=0.50:0.95 | area= all | maxDets=100 ] = 0.624 Average Precision (AP) @[ IoU=0.50 | area= all | maxDets=100 ] = 0.893 Average Precision (AP) @[ IoU=0.75 | area= all | maxDets=100 ] = 0.707 Average Precision (AP) @[ IoU=0.50:0.95 | area= small | maxDets=100 ] = 0.219 Average Precision (AP) @[ IoU=0.50:0.95 | area=medium | maxDets=100 ] = 0.542 Average Precision (AP) @[ IoU=0.50:0.95 | area= large | maxDets=100 ] = 0.729 Average Recall (AR) @[ IoU=0.50:0.95 | area= all | maxDets= 1 ] = 0.043 Average Recall (AR) @[ IoU=0.50:0.95 | area= all | maxDets= 10 ] = 0.331 Average Recall (AR) @[ IoU=0.50:0.95 | area= all | maxDets=100 ] = 0.671 Average Recall (AR) @[ IoU=0.50:0.95 | area= small | maxDets=100 ] = 0.303 Average Recall (AR) @[ IoU=0.50:0.95 | area=medium | maxDets=100 ] = 0.610 Average Recall (AR) @[ IoU=0.50:0.95 | area= large | maxDets=100 ] = 0.767

gt_type _val_half gt_files [] 2024-06-04 07:48:46 | INFO | main:235 - Found 0 groundtruths and 7 test files. 2024-06-04 07:48:46 | INFO | main:236 - Available LAP solvers ['lap', 'scipy'] 2024-06-04 07:48:46 | INFO | main:237 - Default LAP solver 'lap' 2024-06-04 07:48:46 | INFO | main:238 - Loading files. 2024-06-04 07:48:46 | WARNING | main:122 - No ground truth for MOT17-02-FRCNN, skipping. 2024-06-04 07:48:46 | WARNING | main:122 - No ground truth for MOT17-04-FRCNN, skipping. 2024-06-04 07:48:46 | WARNING | main:122 - No ground truth for MOT17-05-FRCNN, skipping. 2024-06-04 07:48:46 | WARNING | main:122 - No ground truth for MOT17-09-FRCNN, skipping. 2024-06-04 07:48:46 | WARNING | main:122 - No ground truth for MOT17-10-FRCNN, skipping. 2024-06-04 07:48:46 | WARNING | main:122 - No ground truth for MOT17-11-FRCNN, skipping. 2024-06-04 07:48:46 | WARNING | main:122 - No ground truth for MOT17-13-FRCNN, skipping. 2024-06-04 07:48:46 | INFO | main:246 - Running metrics Rcll Prcn GT MT PT ML FP FN IDs FM MOTA MOTP num_objects OVERALL NaN NaN 0 NaN NaN NaN NaN NaN NaN NaN NaN NaN 0 IDF1 IDP IDR Rcll Prcn GT MT PT ML FP FN IDs FM MOTA MOTP IDt IDa IDm num_objects OVERALL NaN NaN NaN NaN NaN 0 0 0 0 0 0 0 0 NaN NaN 0 0 0 0 2024-06-04 07:48:46 | INFO | main:271 - Completed

[oemksrg]

In your result print, gt_files is showing as empty and the message "2024-06-04 07:48:46 | WARNING | main:122 - No ground truth for MOT17-02-FRCNN, skipping." is displayed. You might want to check if the gt.txt file is stored in the correct location.

[sakai5678]

結果の印刷では、gt_files が空として表示され、「2024-06-04 07:48:46 | 警告 | main:122 - MOT17-02-FRCNN のグラウンド トゥルースがないため、スキップします。」というメッセージが表示されます。gt.txt ファイルが正しい場所に保存されているかどうかを確認することをお勧めします。

回答ありがとうございます。 gt.txtファイルの存在を確認してみたところ、公式のMOT17のデータセットには、training setにはgtファイルが存在しましたが、test setには存在しませんでした。 そのため、別のデータセットを使用しなければならないのでしょうか？ また、MOT17のtraining setを分割してtest setに利用することは可能なのでしょうか？

[oemksrg]

結果の印刷では、gt_files が空として表示され、「2024-06-04 07:48:46 | 警告 | main:122 - MOT17-02-FRCNN のグラウンド トゥルースがないため、スキップします。」というメッセージが表示されます。gt.txt ファイルが正しい場所に保存されているかどうかを確認することをお勧めします。

回答ありがとうございます。 gt.txtファイルの存在を確認してみたところ、公式のMOT17のデータセットには、training setにはgtファイルが存在しましたが、test setには存在しませんでした。 そのため、別のデータセットを使用しなければならないのでしょうか？ また、MOT17のtraining setを分割してtest setに利用することは可能なのでしょうか？

I am currently learning to use these tools, so my answers may not be entirely accurate. If there are any mistakes, please point them out.

In the MOT17 dataset, the test set does not have a gt.txt file. You need to submit the generated txt file to the MOTChallenge website to obtain the MOTA score. The author mentioned in the paper that both datasets contain training sets and test sets, but no validation sets. For ablation studies, we use the first half of each video in the MOT17 training set for training and the last half for validation. For specific details, you can refer to the paper and read the README file.