cvlab-kaist / CAT-Seg

Official Implementation of "CAT-Seg🐱: Cost Aggregation for Open-Vocabulary Semantic Segmentation"
https://ku-cvlab.github.io/CAT-Seg/
MIT License
267 stars 25 forks source link

Results on PC459 #24

Closed lchen1019 closed 6 months ago

lchen1019 commented 6 months ago

I used your public ViT-B checkpoint to verify the mIoU on each data set, and found that PC459's was only 14.6468, which was far lower than the 19.0 in the paper. But the mIoU on other data sets are the same as those in the paper. I am very confused. Have you encountered such a problem before? Where do you think the problem lies?

[05/02 16:00:20 fvcore.common.checkpoint]: [Checkpointer] Loading from tmp//model_final.pth ...
WARNING [05/02 16:00:21 d2.data.datasets.coco]: Directory datasets/VOCdevkit/VOC2010/JPEGImages and datasets/VOCdevkit/VOC2010/annotations_detectron2/pc459_val has 11321 and 5104 files, respectively.
WARNING [05/02 16:00:21 d2.data.datasets.coco]: Will use their intersection of 5104 files.
[05/02 16:00:21 d2.data.datasets.coco]: Loaded 5104 images with semantic segmentation from datasets/VOCdevkit/VOC2010/JPEGImages
[05/02 16:00:21 d2.data.dataset_mapper]: [DatasetMapper] Augmentations used in inference: [ResizeShortestEdge(short_edge_length=(640, 640), max_size=2560, sample_style='choice')]
[05/02 16:00:21 d2.data.common]: Serializing 5104 elements to byte tensors and concatenating them all ...
[05/02 16:00:21 d2.data.common]: Serialized dataset takes 0.89 MiB
WARNING [05/02 16:00:21 d2.data.datasets.coco]: Directory datasets/VOCdevkit/VOC2010/JPEGImages and datasets/VOCdevkit/VOC2010/annotations_detectron2/pc459_val has 11321 and 5104 files, respectively.
WARNING [05/02 16:00:21 d2.data.datasets.coco]: Will use their intersection of 5104 files.
[05/02 16:00:21 d2.data.datasets.coco]: Loaded 5104 images with semantic segmentation from datasets/VOCdevkit/VOC2010/JPEGImages
[05/02 16:00:21 d2.evaluation.evaluator]: Start inference on 1276 batches
[05/02 16:00:35 d2.evaluation.evaluator]: Inference done 11/1276. Dataloading: 0.0015 s/iter. Inference: 0.5899 s/iter. Eval: 0.0102 s/iter. Total: 0.6016 s/iter. ETA=0:12:40
[05/02 16:00:40 d2.evaluation.evaluator]: Inference done 20/1276. Dataloading: 0.0017 s/iter. Inference: 0.5920 s/iter. Eval: 0.0103 s/iter. Total: 0.6040 s/iter. ETA=0:12:38
[05/02 16:00:46 d2.evaluation.evaluator]: Inference done 29/1276. Dataloading: 0.0017 s/iter. Inference: 0.5951 s/iter. Eval: 0.0104 s/iter. Total: 0.6073 s/iter. ETA=0:12:37
[05/02 16:00:51 d2.evaluation.evaluator]: Inference done 38/1276. Dataloading: 0.0018 s/iter. Inference: 0.5963 s/iter. Eval: 0.0107 s/iter. Total: 0.6089 s/iter. ETA=0:12:33
[05/02 16:00:56 d2.evaluation.evaluator]: Inference done 47/1276. Dataloading: 0.0018 s/iter. Inference: 0.5964 s/iter. Eval: 0.0106 s/iter. Total: 0.6088 s/iter. ETA=0:12:28
[05/02 16:01:02 d2.evaluation.evaluator]: Inference done 56/1276. Dataloading: 0.0018 s/iter. Inference: 0.5963 s/iter. Eval: 0.0102 s/iter. Total: 0.6085 s/iter. ETA=0:12:22
[05/02 16:01:07 d2.evaluation.evaluator]: Inference done 65/1276. Dataloading: 0.0019 s/iter. Inference: 0.5964 s/iter. Eval: 0.0103 s/iter. Total: 0.6086 s/iter. ETA=0:12:17
[05/02 16:01:13 d2.evaluation.evaluator]: Inference done 74/1276. Dataloading: 0.0019 s/iter. Inference: 0.5969 s/iter. Eval: 0.0103 s/iter. Total: 0.6091 s/iter. ETA=0:12:12
[05/02 16:01:19 d2.evaluation.evaluator]: Inference done 83/1276. Dataloading: 0.0019 s/iter. Inference: 0.5975 s/iter. Eval: 0.0104 s/iter. Total: 0.6099 s/iter. ETA=0:12:07
[05/02 16:01:24 d2.evaluation.evaluator]: Inference done 92/1276. Dataloading: 0.0019 s/iter. Inference: 0.5986 s/iter. Eval: 0.0103 s/iter. Total: 0.6108 s/iter. ETA=0:12:03
[05/02 16:01:30 d2.evaluation.evaluator]: Inference done 101/1276. Dataloading: 0.0019 s/iter. Inference: 0.5992 s/iter. Eval: 0.0102 s/iter. Total: 0.6114 s/iter. ETA=0:11:58
[05/02 16:01:35 d2.evaluation.evaluator]: Inference done 109/1276. Dataloading: 0.0019 s/iter. Inference: 0.6004 s/iter. Eval: 0.0103 s/iter. Total: 0.6127 s/iter. ETA=0:11:55
[05/02 16:01:40 d2.evaluation.evaluator]: Inference done 117/1276. Dataloading: 0.0019 s/iter. Inference: 0.6014 s/iter. Eval: 0.0103 s/iter. Total: 0.6137 s/iter. ETA=0:11:51
[05/02 16:01:45 d2.evaluation.evaluator]: Inference done 125/1276. Dataloading: 0.0019 s/iter. Inference: 0.6023 s/iter. Eval: 0.0103 s/iter. Total: 0.6146 s/iter. ETA=0:11:47
[05/02 16:01:50 d2.evaluation.evaluator]: Inference done 133/1276. Dataloading: 0.0019 s/iter. Inference: 0.6038 s/iter. Eval: 0.0102 s/iter. Total: 0.6160 s/iter. ETA=0:11:44
[05/02 16:01:55 d2.evaluation.evaluator]: Inference done 141/1276. Dataloading: 0.0019 s/iter. Inference: 0.6047 s/iter. Eval: 0.0103 s/iter. Total: 0.6170 s/iter. ETA=0:11:40
[05/02 16:02:00 d2.evaluation.evaluator]: Inference done 149/1276. Dataloading: 0.0019 s/iter. Inference: 0.6054 s/iter. Eval: 0.0104 s/iter. Total: 0.6178 s/iter. ETA=0:11:36
[05/02 16:02:05 d2.evaluation.evaluator]: Inference done 157/1276. Dataloading: 0.0019 s/iter. Inference: 0.6063 s/iter. Eval: 0.0104 s/iter. Total: 0.6188 s/iter. ETA=0:11:32
[05/02 16:02:10 d2.evaluation.evaluator]: Inference done 165/1276. Dataloading: 0.0019 s/iter. Inference: 0.6070 s/iter. Eval: 0.0103 s/iter. Total: 0.6194 s/iter. ETA=0:11:28
[05/02 16:02:15 d2.evaluation.evaluator]: Inference done 173/1276. Dataloading: 0.0019 s/iter. Inference: 0.6079 s/iter. Eval: 0.0102 s/iter. Total: 0.6202 s/iter. ETA=0:11:24
[05/02 16:02:20 d2.evaluation.evaluator]: Inference done 181/1276. Dataloading: 0.0019 s/iter. Inference: 0.6086 s/iter. Eval: 0.0103 s/iter. Total: 0.6209 s/iter. ETA=0:11:19
[05/02 16:02:25 d2.evaluation.evaluator]: Inference done 189/1276. Dataloading: 0.0019 s/iter. Inference: 0.6097 s/iter. Eval: 0.0102 s/iter. Total: 0.6219 s/iter. ETA=0:11:15
[05/02 16:02:30 d2.evaluation.evaluator]: Inference done 197/1276. Dataloading: 0.0020 s/iter. Inference: 0.6102 s/iter. Eval: 0.0102 s/iter. Total: 0.6224 s/iter. ETA=0:11:11
[05/02 16:02:36 d2.evaluation.evaluator]: Inference done 205/1276. Dataloading: 0.0020 s/iter. Inference: 0.6107 s/iter. Eval: 0.0101 s/iter. Total: 0.6229 s/iter. ETA=0:11:07
[05/02 16:02:41 d2.evaluation.evaluator]: Inference done 213/1276. Dataloading: 0.0020 s/iter. Inference: 0.6112 s/iter. Eval: 0.0102 s/iter. Total: 0.6234 s/iter. ETA=0:11:02
[05/02 16:02:46 d2.evaluation.evaluator]: Inference done 221/1276. Dataloading: 0.0020 s/iter. Inference: 0.6124 s/iter. Eval: 0.0102 s/iter. Total: 0.6246 s/iter. ETA=0:10:58
[05/02 16:02:51 d2.evaluation.evaluator]: Inference done 229/1276. Dataloading: 0.0020 s/iter. Inference: 0.6128 s/iter. Eval: 0.0102 s/iter. Total: 0.6250 s/iter. ETA=0:10:54
[05/02 16:02:56 d2.evaluation.evaluator]: Inference done 237/1276. Dataloading: 0.0020 s/iter. Inference: 0.6136 s/iter. Eval: 0.0102 s/iter. Total: 0.6258 s/iter. ETA=0:10:50
[05/02 16:03:01 d2.evaluation.evaluator]: Inference done 245/1276. Dataloading: 0.0020 s/iter. Inference: 0.6137 s/iter. Eval: 0.0102 s/iter. Total: 0.6259 s/iter. ETA=0:10:45
[05/02 16:03:06 d2.evaluation.evaluator]: Inference done 253/1276. Dataloading: 0.0020 s/iter. Inference: 0.6142 s/iter. Eval: 0.0102 s/iter. Total: 0.6265 s/iter. ETA=0:10:40
[05/02 16:03:12 d2.evaluation.evaluator]: Inference done 261/1276. Dataloading: 0.0020 s/iter. Inference: 0.6151 s/iter. Eval: 0.0102 s/iter. Total: 0.6274 s/iter. ETA=0:10:36
[05/02 16:03:17 d2.evaluation.evaluator]: Inference done 269/1276. Dataloading: 0.0020 s/iter. Inference: 0.6153 s/iter. Eval: 0.0103 s/iter. Total: 0.6276 s/iter. ETA=0:10:32
[05/02 16:03:22 d2.evaluation.evaluator]: Inference done 277/1276. Dataloading: 0.0020 s/iter. Inference: 0.6157 s/iter. Eval: 0.0103 s/iter. Total: 0.6281 s/iter. ETA=0:10:27
[05/02 16:03:27 d2.evaluation.evaluator]: Inference done 285/1276. Dataloading: 0.0020 s/iter. Inference: 0.6160 s/iter. Eval: 0.0103 s/iter. Total: 0.6283 s/iter. ETA=0:10:22
[05/02 16:03:32 d2.evaluation.evaluator]: Inference done 293/1276. Dataloading: 0.0020 s/iter. Inference: 0.6159 s/iter. Eval: 0.0103 s/iter. Total: 0.6283 s/iter. ETA=0:10:17
[05/02 16:03:37 d2.evaluation.evaluator]: Inference done 301/1276. Dataloading: 0.0020 s/iter. Inference: 0.6161 s/iter. Eval: 0.0104 s/iter. Total: 0.6285 s/iter. ETA=0:10:12
[05/02 16:03:42 d2.evaluation.evaluator]: Inference done 309/1276. Dataloading: 0.0020 s/iter. Inference: 0.6163 s/iter. Eval: 0.0104 s/iter. Total: 0.6287 s/iter. ETA=0:10:07
[05/02 16:03:47 d2.evaluation.evaluator]: Inference done 317/1276. Dataloading: 0.0020 s/iter. Inference: 0.6165 s/iter. Eval: 0.0104 s/iter. Total: 0.6289 s/iter. ETA=0:10:03
[05/02 16:03:52 d2.evaluation.evaluator]: Inference done 325/1276. Dataloading: 0.0020 s/iter. Inference: 0.6167 s/iter. Eval: 0.0104 s/iter. Total: 0.6291 s/iter. ETA=0:09:58
[05/02 16:03:57 d2.evaluation.evaluator]: Inference done 333/1276. Dataloading: 0.0020 s/iter. Inference: 0.6168 s/iter. Eval: 0.0104 s/iter. Total: 0.6292 s/iter. ETA=0:09:53
[05/02 16:04:02 d2.evaluation.evaluator]: Inference done 341/1276. Dataloading: 0.0020 s/iter. Inference: 0.6168 s/iter. Eval: 0.0104 s/iter. Total: 0.6292 s/iter. ETA=0:09:48
[05/02 16:04:07 d2.evaluation.evaluator]: Inference done 349/1276. Dataloading: 0.0020 s/iter. Inference: 0.6169 s/iter. Eval: 0.0104 s/iter. Total: 0.6293 s/iter. ETA=0:09:43
[05/02 16:04:12 d2.evaluation.evaluator]: Inference done 357/1276. Dataloading: 0.0020 s/iter. Inference: 0.6170 s/iter. Eval: 0.0103 s/iter. Total: 0.6294 s/iter. ETA=0:09:38
[05/02 16:04:18 d2.evaluation.evaluator]: Inference done 365/1276. Dataloading: 0.0020 s/iter. Inference: 0.6171 s/iter. Eval: 0.0103 s/iter. Total: 0.6295 s/iter. ETA=0:09:33
[05/02 16:04:23 d2.evaluation.evaluator]: Inference done 373/1276. Dataloading: 0.0020 s/iter. Inference: 0.6173 s/iter. Eval: 0.0103 s/iter. Total: 0.6296 s/iter. ETA=0:09:28
[05/02 16:04:28 d2.evaluation.evaluator]: Inference done 381/1276. Dataloading: 0.0020 s/iter. Inference: 0.6173 s/iter. Eval: 0.0103 s/iter. Total: 0.6297 s/iter. ETA=0:09:23
[05/02 16:04:33 d2.evaluation.evaluator]: Inference done 389/1276. Dataloading: 0.0020 s/iter. Inference: 0.6174 s/iter. Eval: 0.0103 s/iter. Total: 0.6297 s/iter. ETA=0:09:18
[05/02 16:04:38 d2.evaluation.evaluator]: Inference done 397/1276. Dataloading: 0.0020 s/iter. Inference: 0.6174 s/iter. Eval: 0.0103 s/iter. Total: 0.6298 s/iter. ETA=0:09:13
[05/02 16:04:43 d2.evaluation.evaluator]: Inference done 405/1276. Dataloading: 0.0020 s/iter. Inference: 0.6174 s/iter. Eval: 0.0103 s/iter. Total: 0.6297 s/iter. ETA=0:09:08
[05/02 16:04:48 d2.evaluation.evaluator]: Inference done 413/1276. Dataloading: 0.0020 s/iter. Inference: 0.6174 s/iter. Eval: 0.0103 s/iter. Total: 0.6297 s/iter. ETA=0:09:03
[05/02 16:04:53 d2.evaluation.evaluator]: Inference done 421/1276. Dataloading: 0.0020 s/iter. Inference: 0.6173 s/iter. Eval: 0.0103 s/iter. Total: 0.6297 s/iter. ETA=0:08:58
[05/02 16:04:58 d2.evaluation.evaluator]: Inference done 429/1276. Dataloading: 0.0020 s/iter. Inference: 0.6176 s/iter. Eval: 0.0103 s/iter. Total: 0.6300 s/iter. ETA=0:08:53
[05/02 16:05:03 d2.evaluation.evaluator]: Inference done 437/1276. Dataloading: 0.0020 s/iter. Inference: 0.6176 s/iter. Eval: 0.0103 s/iter. Total: 0.6300 s/iter. ETA=0:08:48
[05/02 16:05:08 d2.evaluation.evaluator]: Inference done 445/1276. Dataloading: 0.0020 s/iter. Inference: 0.6177 s/iter. Eval: 0.0103 s/iter. Total: 0.6301 s/iter. ETA=0:08:43
[05/02 16:05:13 d2.evaluation.evaluator]: Inference done 453/1276. Dataloading: 0.0020 s/iter. Inference: 0.6178 s/iter. Eval: 0.0103 s/iter. Total: 0.6302 s/iter. ETA=0:08:38
[05/02 16:05:18 d2.evaluation.evaluator]: Inference done 461/1276. Dataloading: 0.0020 s/iter. Inference: 0.6179 s/iter. Eval: 0.0103 s/iter. Total: 0.6303 s/iter. ETA=0:08:33
[05/02 16:05:23 d2.evaluation.evaluator]: Inference done 469/1276. Dataloading: 0.0020 s/iter. Inference: 0.6179 s/iter. Eval: 0.0104 s/iter. Total: 0.6304 s/iter. ETA=0:08:28
[05/02 16:05:29 d2.evaluation.evaluator]: Inference done 477/1276. Dataloading: 0.0020 s/iter. Inference: 0.6181 s/iter. Eval: 0.0103 s/iter. Total: 0.6305 s/iter. ETA=0:08:23
[05/02 16:05:34 d2.evaluation.evaluator]: Inference done 485/1276. Dataloading: 0.0020 s/iter. Inference: 0.6181 s/iter. Eval: 0.0103 s/iter. Total: 0.6305 s/iter. ETA=0:08:18
[05/02 16:05:39 d2.evaluation.evaluator]: Inference done 493/1276. Dataloading: 0.0020 s/iter. Inference: 0.6186 s/iter. Eval: 0.0103 s/iter. Total: 0.6310 s/iter. ETA=0:08:14
[05/02 16:05:44 d2.evaluation.evaluator]: Inference done 501/1276. Dataloading: 0.0020 s/iter. Inference: 0.6186 s/iter. Eval: 0.0103 s/iter. Total: 0.6309 s/iter. ETA=0:08:08
[05/02 16:05:49 d2.evaluation.evaluator]: Inference done 509/1276. Dataloading: 0.0020 s/iter. Inference: 0.6186 s/iter. Eval: 0.0103 s/iter. Total: 0.6310 s/iter. ETA=0:08:03
[05/02 16:05:54 d2.evaluation.evaluator]: Inference done 517/1276. Dataloading: 0.0020 s/iter. Inference: 0.6186 s/iter. Eval: 0.0103 s/iter. Total: 0.6310 s/iter. ETA=0:07:58
[05/02 16:05:59 d2.evaluation.evaluator]: Inference done 525/1276. Dataloading: 0.0020 s/iter. Inference: 0.6189 s/iter. Eval: 0.0103 s/iter. Total: 0.6313 s/iter. ETA=0:07:54
[05/02 16:06:04 d2.evaluation.evaluator]: Inference done 533/1276. Dataloading: 0.0020 s/iter. Inference: 0.6189 s/iter. Eval: 0.0103 s/iter. Total: 0.6312 s/iter. ETA=0:07:49
[05/02 16:06:09 d2.evaluation.evaluator]: Inference done 541/1276. Dataloading: 0.0020 s/iter. Inference: 0.6189 s/iter. Eval: 0.0102 s/iter. Total: 0.6312 s/iter. ETA=0:07:43
[05/02 16:06:14 d2.evaluation.evaluator]: Inference done 549/1276. Dataloading: 0.0020 s/iter. Inference: 0.6189 s/iter. Eval: 0.0103 s/iter. Total: 0.6313 s/iter. ETA=0:07:38
[05/02 16:06:19 d2.evaluation.evaluator]: Inference done 557/1276. Dataloading: 0.0020 s/iter. Inference: 0.6189 s/iter. Eval: 0.0103 s/iter. Total: 0.6313 s/iter. ETA=0:07:33
[05/02 16:06:25 d2.evaluation.evaluator]: Inference done 565/1276. Dataloading: 0.0020 s/iter. Inference: 0.6192 s/iter. Eval: 0.0103 s/iter. Total: 0.6315 s/iter. ETA=0:07:29
[05/02 16:06:30 d2.evaluation.evaluator]: Inference done 573/1276. Dataloading: 0.0020 s/iter. Inference: 0.6193 s/iter. Eval: 0.0103 s/iter. Total: 0.6316 s/iter. ETA=0:07:24
[05/02 16:06:35 d2.evaluation.evaluator]: Inference done 581/1276. Dataloading: 0.0020 s/iter. Inference: 0.6193 s/iter. Eval: 0.0103 s/iter. Total: 0.6317 s/iter. ETA=0:07:19
[05/02 16:06:40 d2.evaluation.evaluator]: Inference done 589/1276. Dataloading: 0.0020 s/iter. Inference: 0.6194 s/iter. Eval: 0.0103 s/iter. Total: 0.6318 s/iter. ETA=0:07:14
[05/02 16:06:45 d2.evaluation.evaluator]: Inference done 597/1276. Dataloading: 0.0020 s/iter. Inference: 0.6195 s/iter. Eval: 0.0103 s/iter. Total: 0.6318 s/iter. ETA=0:07:08
[05/02 16:06:50 d2.evaluation.evaluator]: Inference done 605/1276. Dataloading: 0.0020 s/iter. Inference: 0.6194 s/iter. Eval: 0.0103 s/iter. Total: 0.6318 s/iter. ETA=0:07:03
[05/02 16:06:55 d2.evaluation.evaluator]: Inference done 613/1276. Dataloading: 0.0020 s/iter. Inference: 0.6195 s/iter. Eval: 0.0103 s/iter. Total: 0.6319 s/iter. ETA=0:06:58
[05/02 16:07:00 d2.evaluation.evaluator]: Inference done 621/1276. Dataloading: 0.0020 s/iter. Inference: 0.6195 s/iter. Eval: 0.0103 s/iter. Total: 0.6319 s/iter. ETA=0:06:53
[05/02 16:07:05 d2.evaluation.evaluator]: Inference done 629/1276. Dataloading: 0.0020 s/iter. Inference: 0.6196 s/iter. Eval: 0.0103 s/iter. Total: 0.6320 s/iter. ETA=0:06:48
[05/02 16:07:10 d2.evaluation.evaluator]: Inference done 637/1276. Dataloading: 0.0020 s/iter. Inference: 0.6197 s/iter. Eval: 0.0103 s/iter. Total: 0.6320 s/iter. ETA=0:06:43
[05/02 16:07:15 d2.evaluation.evaluator]: Inference done 645/1276. Dataloading: 0.0020 s/iter. Inference: 0.6198 s/iter. Eval: 0.0103 s/iter. Total: 0.6321 s/iter. ETA=0:06:38
[05/02 16:07:21 d2.evaluation.evaluator]: Inference done 653/1276. Dataloading: 0.0020 s/iter. Inference: 0.6198 s/iter. Eval: 0.0103 s/iter. Total: 0.6322 s/iter. ETA=0:06:33
[05/02 16:07:26 d2.evaluation.evaluator]: Inference done 661/1276. Dataloading: 0.0020 s/iter. Inference: 0.6199 s/iter. Eval: 0.0103 s/iter. Total: 0.6322 s/iter. ETA=0:06:28
[05/02 16:07:31 d2.evaluation.evaluator]: Inference done 669/1276. Dataloading: 0.0020 s/iter. Inference: 0.6200 s/iter. Eval: 0.0103 s/iter. Total: 0.6324 s/iter. ETA=0:06:23
[05/02 16:07:36 d2.evaluation.evaluator]: Inference done 677/1276. Dataloading: 0.0020 s/iter. Inference: 0.6200 s/iter. Eval: 0.0103 s/iter. Total: 0.6324 s/iter. ETA=0:06:18
[05/02 16:07:41 d2.evaluation.evaluator]: Inference done 686/1276. Dataloading: 0.0020 s/iter. Inference: 0.6198 s/iter. Eval: 0.0103 s/iter. Total: 0.6322 s/iter. ETA=0:06:13
[05/02 16:07:47 d2.evaluation.evaluator]: Inference done 694/1276. Dataloading: 0.0020 s/iter. Inference: 0.6198 s/iter. Eval: 0.0103 s/iter. Total: 0.6323 s/iter. ETA=0:06:07
[05/02 16:07:52 d2.evaluation.evaluator]: Inference done 702/1276. Dataloading: 0.0020 s/iter. Inference: 0.6199 s/iter. Eval: 0.0103 s/iter. Total: 0.6323 s/iter. ETA=0:06:02
[05/02 16:07:57 d2.evaluation.evaluator]: Inference done 710/1276. Dataloading: 0.0020 s/iter. Inference: 0.6199 s/iter. Eval: 0.0103 s/iter. Total: 0.6323 s/iter. ETA=0:05:57
[05/02 16:08:02 d2.evaluation.evaluator]: Inference done 718/1276. Dataloading: 0.0020 s/iter. Inference: 0.6199 s/iter. Eval: 0.0103 s/iter. Total: 0.6323 s/iter. ETA=0:05:52
[05/02 16:08:07 d2.evaluation.evaluator]: Inference done 726/1276. Dataloading: 0.0020 s/iter. Inference: 0.6199 s/iter. Eval: 0.0103 s/iter. Total: 0.6323 s/iter. ETA=0:05:47
[05/02 16:08:12 d2.evaluation.evaluator]: Inference done 734/1276. Dataloading: 0.0020 s/iter. Inference: 0.6199 s/iter. Eval: 0.0104 s/iter. Total: 0.6323 s/iter. ETA=0:05:42
[05/02 16:08:17 d2.evaluation.evaluator]: Inference done 742/1276. Dataloading: 0.0020 s/iter. Inference: 0.6199 s/iter. Eval: 0.0103 s/iter. Total: 0.6323 s/iter. ETA=0:05:37
[05/02 16:08:22 d2.evaluation.evaluator]: Inference done 750/1276. Dataloading: 0.0020 s/iter. Inference: 0.6198 s/iter. Eval: 0.0104 s/iter. Total: 0.6322 s/iter. ETA=0:05:32
[05/02 16:08:27 d2.evaluation.evaluator]: Inference done 758/1276. Dataloading: 0.0020 s/iter. Inference: 0.6199 s/iter. Eval: 0.0104 s/iter. Total: 0.6323 s/iter. ETA=0:05:27
[05/02 16:08:32 d2.evaluation.evaluator]: Inference done 766/1276. Dataloading: 0.0020 s/iter. Inference: 0.6198 s/iter. Eval: 0.0104 s/iter. Total: 0.6323 s/iter. ETA=0:05:22
[05/02 16:08:37 d2.evaluation.evaluator]: Inference done 774/1276. Dataloading: 0.0020 s/iter. Inference: 0.6197 s/iter. Eval: 0.0104 s/iter. Total: 0.6322 s/iter. ETA=0:05:17
[05/02 16:08:42 d2.evaluation.evaluator]: Inference done 782/1276. Dataloading: 0.0020 s/iter. Inference: 0.6197 s/iter. Eval: 0.0104 s/iter. Total: 0.6322 s/iter. ETA=0:05:12
[05/02 16:08:47 d2.evaluation.evaluator]: Inference done 790/1276. Dataloading: 0.0020 s/iter. Inference: 0.6197 s/iter. Eval: 0.0104 s/iter. Total: 0.6322 s/iter. ETA=0:05:07
[05/02 16:08:52 d2.evaluation.evaluator]: Inference done 798/1276. Dataloading: 0.0020 s/iter. Inference: 0.6197 s/iter. Eval: 0.0104 s/iter. Total: 0.6323 s/iter. ETA=0:05:02
[05/02 16:08:58 d2.evaluation.evaluator]: Inference done 806/1276. Dataloading: 0.0020 s/iter. Inference: 0.6200 s/iter. Eval: 0.0104 s/iter. Total: 0.6325 s/iter. ETA=0:04:57
[05/02 16:09:03 d2.evaluation.evaluator]: Inference done 814/1276. Dataloading: 0.0020 s/iter. Inference: 0.6199 s/iter. Eval: 0.0105 s/iter. Total: 0.6325 s/iter. ETA=0:04:52
[05/02 16:09:08 d2.evaluation.evaluator]: Inference done 822/1276. Dataloading: 0.0020 s/iter. Inference: 0.6200 s/iter. Eval: 0.0105 s/iter. Total: 0.6326 s/iter. ETA=0:04:47
[05/02 16:09:13 d2.evaluation.evaluator]: Inference done 830/1276. Dataloading: 0.0020 s/iter. Inference: 0.6200 s/iter. Eval: 0.0105 s/iter. Total: 0.6327 s/iter. ETA=0:04:42
[05/02 16:09:18 d2.evaluation.evaluator]: Inference done 838/1276. Dataloading: 0.0020 s/iter. Inference: 0.6200 s/iter. Eval: 0.0105 s/iter. Total: 0.6326 s/iter. ETA=0:04:37
[05/02 16:09:23 d2.evaluation.evaluator]: Inference done 846/1276. Dataloading: 0.0020 s/iter. Inference: 0.6202 s/iter. Eval: 0.0105 s/iter. Total: 0.6328 s/iter. ETA=0:04:32
[05/02 16:09:28 d2.evaluation.evaluator]: Inference done 854/1276. Dataloading: 0.0020 s/iter. Inference: 0.6202 s/iter. Eval: 0.0105 s/iter. Total: 0.6328 s/iter. ETA=0:04:27
[05/02 16:09:33 d2.evaluation.evaluator]: Inference done 862/1276. Dataloading: 0.0020 s/iter. Inference: 0.6201 s/iter. Eval: 0.0105 s/iter. Total: 0.6328 s/iter. ETA=0:04:21
[05/02 16:09:38 d2.evaluation.evaluator]: Inference done 870/1276. Dataloading: 0.0020 s/iter. Inference: 0.6202 s/iter. Eval: 0.0105 s/iter. Total: 0.6328 s/iter. ETA=0:04:16
[05/02 16:09:43 d2.evaluation.evaluator]: Inference done 878/1276. Dataloading: 0.0020 s/iter. Inference: 0.6202 s/iter. Eval: 0.0105 s/iter. Total: 0.6328 s/iter. ETA=0:04:11
[05/02 16:09:48 d2.evaluation.evaluator]: Inference done 886/1276. Dataloading: 0.0020 s/iter. Inference: 0.6201 s/iter. Eval: 0.0105 s/iter. Total: 0.6328 s/iter. ETA=0:04:06
[05/02 16:09:53 d2.evaluation.evaluator]: Inference done 894/1276. Dataloading: 0.0020 s/iter. Inference: 0.6202 s/iter. Eval: 0.0105 s/iter. Total: 0.6328 s/iter. ETA=0:04:01
[05/02 16:09:59 d2.evaluation.evaluator]: Inference done 902/1276. Dataloading: 0.0020 s/iter. Inference: 0.6202 s/iter. Eval: 0.0105 s/iter. Total: 0.6328 s/iter. ETA=0:03:56
[05/02 16:10:04 d2.evaluation.evaluator]: Inference done 910/1276. Dataloading: 0.0020 s/iter. Inference: 0.6203 s/iter. Eval: 0.0105 s/iter. Total: 0.6329 s/iter. ETA=0:03:51
[05/02 16:10:09 d2.evaluation.evaluator]: Inference done 918/1276. Dataloading: 0.0020 s/iter. Inference: 0.6203 s/iter. Eval: 0.0105 s/iter. Total: 0.6329 s/iter. ETA=0:03:46
[05/02 16:10:14 d2.evaluation.evaluator]: Inference done 926/1276. Dataloading: 0.0020 s/iter. Inference: 0.6203 s/iter. Eval: 0.0105 s/iter. Total: 0.6329 s/iter. ETA=0:03:41
[05/02 16:10:19 d2.evaluation.evaluator]: Inference done 934/1276. Dataloading: 0.0020 s/iter. Inference: 0.6203 s/iter. Eval: 0.0105 s/iter. Total: 0.6329 s/iter. ETA=0:03:36
[05/02 16:10:24 d2.evaluation.evaluator]: Inference done 942/1276. Dataloading: 0.0020 s/iter. Inference: 0.6205 s/iter. Eval: 0.0105 s/iter. Total: 0.6331 s/iter. ETA=0:03:31
[05/02 16:10:29 d2.evaluation.evaluator]: Inference done 950/1276. Dataloading: 0.0020 s/iter. Inference: 0.6204 s/iter. Eval: 0.0105 s/iter. Total: 0.6331 s/iter. ETA=0:03:26
[05/02 16:10:34 d2.evaluation.evaluator]: Inference done 958/1276. Dataloading: 0.0020 s/iter. Inference: 0.6206 s/iter. Eval: 0.0105 s/iter. Total: 0.6332 s/iter. ETA=0:03:21
[05/02 16:10:39 d2.evaluation.evaluator]: Inference done 966/1276. Dataloading: 0.0020 s/iter. Inference: 0.6206 s/iter. Eval: 0.0105 s/iter. Total: 0.6332 s/iter. ETA=0:03:16
[05/02 16:10:45 d2.evaluation.evaluator]: Inference done 974/1276. Dataloading: 0.0020 s/iter. Inference: 0.6206 s/iter. Eval: 0.0105 s/iter. Total: 0.6332 s/iter. ETA=0:03:11
[05/02 16:10:50 d2.evaluation.evaluator]: Inference done 982/1276. Dataloading: 0.0020 s/iter. Inference: 0.6206 s/iter. Eval: 0.0105 s/iter. Total: 0.6332 s/iter. ETA=0:03:06
[05/02 16:10:55 d2.evaluation.evaluator]: Inference done 990/1276. Dataloading: 0.0020 s/iter. Inference: 0.6207 s/iter. Eval: 0.0105 s/iter. Total: 0.6332 s/iter. ETA=0:03:01
[05/02 16:11:00 d2.evaluation.evaluator]: Inference done 998/1276. Dataloading: 0.0020 s/iter. Inference: 0.6207 s/iter. Eval: 0.0105 s/iter. Total: 0.6333 s/iter. ETA=0:02:56
[05/02 16:11:05 d2.evaluation.evaluator]: Inference done 1006/1276. Dataloading: 0.0020 s/iter. Inference: 0.6208 s/iter. Eval: 0.0105 s/iter. Total: 0.6333 s/iter. ETA=0:02:50
[05/02 16:11:10 d2.evaluation.evaluator]: Inference done 1014/1276. Dataloading: 0.0020 s/iter. Inference: 0.6208 s/iter. Eval: 0.0105 s/iter. Total: 0.6334 s/iter. ETA=0:02:45
[05/02 16:11:15 d2.evaluation.evaluator]: Inference done 1022/1276. Dataloading: 0.0020 s/iter. Inference: 0.6209 s/iter. Eval: 0.0105 s/iter. Total: 0.6334 s/iter. ETA=0:02:40
[05/02 16:11:20 d2.evaluation.evaluator]: Inference done 1030/1276. Dataloading: 0.0020 s/iter. Inference: 0.6209 s/iter. Eval: 0.0105 s/iter. Total: 0.6335 s/iter. ETA=0:02:35
[05/02 16:11:25 d2.evaluation.evaluator]: Inference done 1038/1276. Dataloading: 0.0020 s/iter. Inference: 0.6209 s/iter. Eval: 0.0105 s/iter. Total: 0.6335 s/iter. ETA=0:02:30
[05/02 16:11:30 d2.evaluation.evaluator]: Inference done 1046/1276. Dataloading: 0.0020 s/iter. Inference: 0.6209 s/iter. Eval: 0.0105 s/iter. Total: 0.6335 s/iter. ETA=0:02:25
[05/02 16:11:35 d2.evaluation.evaluator]: Inference done 1054/1276. Dataloading: 0.0020 s/iter. Inference: 0.6210 s/iter. Eval: 0.0105 s/iter. Total: 0.6335 s/iter. ETA=0:02:20
[05/02 16:11:41 d2.evaluation.evaluator]: Inference done 1062/1276. Dataloading: 0.0020 s/iter. Inference: 0.6210 s/iter. Eval: 0.0105 s/iter. Total: 0.6335 s/iter. ETA=0:02:15
[05/02 16:11:46 d2.evaluation.evaluator]: Inference done 1070/1276. Dataloading: 0.0020 s/iter. Inference: 0.6210 s/iter. Eval: 0.0105 s/iter. Total: 0.6336 s/iter. ETA=0:02:10
[05/02 16:11:51 d2.evaluation.evaluator]: Inference done 1078/1276. Dataloading: 0.0020 s/iter. Inference: 0.6210 s/iter. Eval: 0.0105 s/iter. Total: 0.6336 s/iter. ETA=0:02:05
[05/02 16:11:56 d2.evaluation.evaluator]: Inference done 1086/1276. Dataloading: 0.0020 s/iter. Inference: 0.6210 s/iter. Eval: 0.0105 s/iter. Total: 0.6336 s/iter. ETA=0:02:00
[05/02 16:12:01 d2.evaluation.evaluator]: Inference done 1094/1276. Dataloading: 0.0020 s/iter. Inference: 0.6210 s/iter. Eval: 0.0104 s/iter. Total: 0.6335 s/iter. ETA=0:01:55
[05/02 16:12:06 d2.evaluation.evaluator]: Inference done 1102/1276. Dataloading: 0.0020 s/iter. Inference: 0.6210 s/iter. Eval: 0.0104 s/iter. Total: 0.6335 s/iter. ETA=0:01:50
[05/02 16:12:11 d2.evaluation.evaluator]: Inference done 1110/1276. Dataloading: 0.0020 s/iter. Inference: 0.6209 s/iter. Eval: 0.0104 s/iter. Total: 0.6335 s/iter. ETA=0:01:45
[05/02 16:12:16 d2.evaluation.evaluator]: Inference done 1118/1276. Dataloading: 0.0020 s/iter. Inference: 0.6210 s/iter. Eval: 0.0104 s/iter. Total: 0.6335 s/iter. ETA=0:01:40
[05/02 16:12:21 d2.evaluation.evaluator]: Inference done 1126/1276. Dataloading: 0.0020 s/iter. Inference: 0.6210 s/iter. Eval: 0.0105 s/iter. Total: 0.6335 s/iter. ETA=0:01:35
[05/02 16:12:26 d2.evaluation.evaluator]: Inference done 1134/1276. Dataloading: 0.0020 s/iter. Inference: 0.6209 s/iter. Eval: 0.0105 s/iter. Total: 0.6335 s/iter. ETA=0:01:29
[05/02 16:12:31 d2.evaluation.evaluator]: Inference done 1142/1276. Dataloading: 0.0020 s/iter. Inference: 0.6209 s/iter. Eval: 0.0105 s/iter. Total: 0.6335 s/iter. ETA=0:01:24
[05/02 16:12:36 d2.evaluation.evaluator]: Inference done 1150/1276. Dataloading: 0.0020 s/iter. Inference: 0.6209 s/iter. Eval: 0.0105 s/iter. Total: 0.6335 s/iter. ETA=0:01:19
[05/02 16:12:41 d2.evaluation.evaluator]: Inference done 1158/1276. Dataloading: 0.0020 s/iter. Inference: 0.6209 s/iter. Eval: 0.0105 s/iter. Total: 0.6334 s/iter. ETA=0:01:14
[05/02 16:12:46 d2.evaluation.evaluator]: Inference done 1166/1276. Dataloading: 0.0020 s/iter. Inference: 0.6209 s/iter. Eval: 0.0105 s/iter. Total: 0.6334 s/iter. ETA=0:01:09
[05/02 16:12:51 d2.evaluation.evaluator]: Inference done 1174/1276. Dataloading: 0.0020 s/iter. Inference: 0.6208 s/iter. Eval: 0.0105 s/iter. Total: 0.6334 s/iter. ETA=0:01:04
[05/02 16:12:56 d2.evaluation.evaluator]: Inference done 1182/1276. Dataloading: 0.0020 s/iter. Inference: 0.6209 s/iter. Eval: 0.0105 s/iter. Total: 0.6334 s/iter. ETA=0:00:59
[05/02 16:13:02 d2.evaluation.evaluator]: Inference done 1190/1276. Dataloading: 0.0020 s/iter. Inference: 0.6208 s/iter. Eval: 0.0105 s/iter. Total: 0.6334 s/iter. ETA=0:00:54
[05/02 16:13:07 d2.evaluation.evaluator]: Inference done 1199/1276. Dataloading: 0.0020 s/iter. Inference: 0.6208 s/iter. Eval: 0.0104 s/iter. Total: 0.6333 s/iter. ETA=0:00:48
[05/02 16:13:12 d2.evaluation.evaluator]: Inference done 1207/1276. Dataloading: 0.0020 s/iter. Inference: 0.6208 s/iter. Eval: 0.0104 s/iter. Total: 0.6333 s/iter. ETA=0:00:43
[05/02 16:13:17 d2.evaluation.evaluator]: Inference done 1215/1276. Dataloading: 0.0020 s/iter. Inference: 0.6208 s/iter. Eval: 0.0104 s/iter. Total: 0.6333 s/iter. ETA=0:00:38
[05/02 16:13:22 d2.evaluation.evaluator]: Inference done 1223/1276. Dataloading: 0.0020 s/iter. Inference: 0.6209 s/iter. Eval: 0.0104 s/iter. Total: 0.6334 s/iter. ETA=0:00:33
[05/02 16:13:28 d2.evaluation.evaluator]: Inference done 1231/1276. Dataloading: 0.0020 s/iter. Inference: 0.6211 s/iter. Eval: 0.0104 s/iter. Total: 0.6336 s/iter. ETA=0:00:28
[05/02 16:13:33 d2.evaluation.evaluator]: Inference done 1239/1276. Dataloading: 0.0020 s/iter. Inference: 0.6211 s/iter. Eval: 0.0104 s/iter. Total: 0.6336 s/iter. ETA=0:00:23
[05/02 16:13:38 d2.evaluation.evaluator]: Inference done 1247/1276. Dataloading: 0.0020 s/iter. Inference: 0.6211 s/iter. Eval: 0.0104 s/iter. Total: 0.6336 s/iter. ETA=0:00:18
[05/02 16:13:43 d2.evaluation.evaluator]: Inference done 1255/1276. Dataloading: 0.0020 s/iter. Inference: 0.6211 s/iter. Eval: 0.0104 s/iter. Total: 0.6336 s/iter. ETA=0:00:13
[05/02 16:13:48 d2.evaluation.evaluator]: Inference done 1263/1276. Dataloading: 0.0020 s/iter. Inference: 0.6211 s/iter. Eval: 0.0104 s/iter. Total: 0.6336 s/iter. ETA=0:00:08
[05/02 16:13:53 d2.evaluation.evaluator]: Inference done 1271/1276. Dataloading: 0.0020 s/iter. Inference: 0.6212 s/iter. Eval: 0.0104 s/iter. Total: 0.6337 s/iter. ETA=0:00:03
[05/02 16:13:57 d2.evaluation.evaluator]: Total inference time: 0:13:25.875154 (0.634048 s / iter per device, on 4 devices)
[05/02 16:13:57 d2.evaluation.evaluator]: Total inference pure compute time: 0:13:09 (0.621160 s / iter per device, on 4 devices)
[05/02 16:15:30 d2.evaluation.sem_seg_evaluation]: OrderedDict([('sem_seg', {'mIoU': 14.64680967680913, 'fwIoU': 58.859599998848665, 'IoU-accordion': nan, 'IoU-aeroplane': 83.34707296608741, 'IoU-airconditioner': 0.0, 'IoU-antenna': 0.0, 'IoU-artillery': 15.84080717488789, 'IoU-ashtray': 2.9734583915386152, 'IoU-atrium': nan, 'IoU-babycarriage': 22.954679951765584, 'IoU-bag': 24.958904865371853, 'IoU-ball': 36.88637790332706, 'IoU-balloon': 25.236848710868863, 'IoU-bambooweaving': 12.3152017088572, 'IoU-barrel': 0.0, 'IoU-baseballbat': nan, 'IoU-basket': 27.118580678338517, 'IoU-basketballbackboard': 37.90264853256979, 'IoU-bathtub': 18.315264443267132, 'IoU-bed': 18.791969926141114, 'IoU-bedclothes': 10.860789067899738, 'IoU-beer': 0.6311734492295535, 'IoU-bell': 0.0, 'IoU-bench': 22.445256441587734, 'IoU-bicycle': 74.34504304481013, 'IoU-binoculars': nan, 'IoU-bird': 81.94359371226231, 'IoU-birdcage': 31.37700895917166, 'IoU-birdfeeder': 25.040517766475613, 'IoU-birdnest': 25.40292961154561, 'IoU-blackboard': 9.097666927359594, 'IoU-board': 0.36956033080390294, 'IoU-boat': 73.42959855581998, 'IoU-bone': 0.0, 'IoU-book': 42.14515461291042, 'IoU-bottle': 66.31780104834905, 'IoU-bottleopener': 0.0, 'IoU-bowl': 19.924025275673777, 'IoU-box': 39.38571559694634, 'IoU-bracelet': nan, 'IoU-brick': 0.45833412611161045, 'IoU-bridge': 16.853444127709988, 'IoU-broom': 4.111438389788905, 'IoU-brush': 0.0, 'IoU-bucket': 27.374370589414422, 'IoU-building': 31.172342693947364, 'IoU-bus': 87.92507705737974, 'IoU-cabinet': 35.30465587077401, 'IoU-cabinetdoor': nan, 'IoU-cage': 23.431812216858948, 'IoU-cake': 8.762564388836704, 'IoU-calculator': 0.0, 'IoU-calendar': 17.132227626054785, 'IoU-camel': nan, 'IoU-camera': 46.67469414637067, 'IoU-cameralens': nan, 'IoU-can': 37.14618998258921, 'IoU-candle': 6.571642194683508, 'IoU-candleholder': 6.41339665083729, 'IoU-cap': 0.0, 'IoU-car': 75.06509653280628, 'IoU-card': 0.0, 'IoU-cart': 27.349624060150372, 'IoU-case': 3.6428156244277, 'IoU-casetterecorder': 0.0, 'IoU-cashregister': 0.0, 'IoU-cat': 89.30970445435182, 'IoU-cd': 9.446758453468412, 'IoU-cdplayer': 1.332727199489006, 'IoU-ceiling': 48.72188636082676, 'IoU-cellphone': 9.333719163712653, 'IoU-cello': 72.889694867145, 'IoU-chain': 5.007597064623541, 'IoU-chair': 50.12347705103623, 'IoU-chessboard': nan, 'IoU-chicken': nan, 'IoU-chopstick': 39.09644194756554, 'IoU-clip': 0.0, 'IoU-clippers': 0.0, 'IoU-clock': 15.44817736670294, 'IoU-closet': nan, 'IoU-cloth': 4.041476645510758, 'IoU-clothestree': nan, 'IoU-coffee': 0.0, 'IoU-coffeemachine': nan, 'IoU-comb': 0.0, 'IoU-computer': 11.82693287683643, 'IoU-concrete': 0.36241850726756425, 'IoU-cone': 30.672928584105836, 'IoU-container': 0.5079927039047365, 'IoU-controlbooth': nan, 'IoU-controller': 0.0, 'IoU-cooker': nan, 'IoU-copyingmachine': nan, 'IoU-coral': nan, 'IoU-cork': nan, 'IoU-corkscrew': nan, 'IoU-counter': 14.404898941189892, 'IoU-court': nan, 'IoU-cow': 91.30581139390708, 'IoU-crabstick': nan, 'IoU-crane': 4.083026194550481, 'IoU-crate': 0.0, 'IoU-cross': 4.406112308990344, 'IoU-crutch': 0.0, 'IoU-cup': 37.255589583048106, 'IoU-curtain': 45.143510293171545, 'IoU-cushion': 2.8576254790240223, 'IoU-cuttingboard': 0.0, 'IoU-dais': 11.237354481216004, 'IoU-disc': 0.0, 'IoU-disccase': 0.0, 'IoU-dishwasher': nan, 'IoU-dock': nan, 'IoU-dog': 89.49732338044716, 'IoU-dolphin': nan, 'IoU-door': 24.61800885390309, 'IoU-drainer': nan, 'IoU-dray': nan, 'IoU-drinkdispenser': nan, 'IoU-drinkingmachine': 0.0, 'IoU-drop': nan, 'IoU-drug': 62.916228531370486, 'IoU-drum': 0.0, 'IoU-drumkit': 5.386076205099196, 'IoU-duck': 14.947474796867233, 'IoU-dumbbell': nan, 'IoU-earphone': 1.5908504600567548, 'IoU-earrings': nan, 'IoU-egg': 35.35085096723471, 'IoU-electricfan': 0.5140657694195448, 'IoU-electriciron': 0.0, 'IoU-electricpot': 0.0, 'IoU-electricsaw': nan, 'IoU-electronickeyboard': nan, 'IoU-engine': 0.0, 'IoU-envelope': nan, 'IoU-equipment': 20.54017254704342, 'IoU-escalator': nan, 'IoU-exhibitionbooth': 0.32119914346895073, 'IoU-extinguisher': 41.3152610441767, 'IoU-eyeglass': 0.0, 'IoU-fan': 33.031831267737914, 'IoU-faucet': 12.132798657092232, 'IoU-faxmachine': nan, 'IoU-fence': 36.84349880178753, 'IoU-ferriswheel': 54.33689060222838, 'IoU-fireextinguisher': nan, 'IoU-firehydrant': nan, 'IoU-fireplace': 29.65417959072763, 'IoU-fish': 44.52294147012995, 'IoU-fishtank': 70.00901146590465, 'IoU-fishbowl': 0.0, 'IoU-fishingnet': 23.908092628920606, 'IoU-fishingpole': 0.0, 'IoU-flag': 36.960381299652376, 'IoU-flagstaff': 0.0, 'IoU-flame': nan, 'IoU-flashlight': 0.0, 'IoU-floor': 54.68383499503582, 'IoU-flower': 33.374107976675546, 'IoU-fly': 17.05521472392638, 'IoU-foam': nan, 'IoU-food': 30.947681914360714, 'IoU-footbridge': nan, 'IoU-forceps': nan, 'IoU-fork': 23.110573474181706, 'IoU-forklift': nan, 'IoU-fountain': 0.0018386183396050648, 'IoU-fox': nan, 'IoU-frame': 0.0, 'IoU-fridge': 23.53947903352558, 'IoU-frog': nan, 'IoU-fruit': 0.0, 'IoU-funnel': nan, 'IoU-furnace': 0.0, 'IoU-gamecontroller': 14.031933256616803, 'IoU-gamemachine': 23.43676825143531, 'IoU-gascylinder': nan, 'IoU-gashood': nan, 'IoU-gasstove': nan, 'IoU-giftbox': 10.957816692333338, 'IoU-glass': 0.5919438222983734, 'IoU-glassmarble': 0.20036130727541468, 'IoU-globe': nan, 'IoU-glove': 39.708696430292264, 'IoU-goal': 10.13261117607791, 'IoU-grandstand': 17.592984808545005, 'IoU-grass': 76.16390544485795, 'IoU-gravestone': nan, 'IoU-ground': 20.098398895850682, 'IoU-guardrail': 15.14495962933942, 'IoU-guitar': 53.101029434586934, 'IoU-gun': 6.831503579952266, 'IoU-hammer': 3.2355915065722956, 'IoU-handcart': 0.0, 'IoU-handle': 0.0, 'IoU-handrail': 2.764338973868946, 'IoU-hanger': 0.0, 'IoU-harddiskdrive': nan, 'IoU-hat': 18.15522764188242, 'IoU-hay': 1.960825775006575, 'IoU-headphone': 1.0122850122850124, 'IoU-heater': 0.0, 'IoU-helicopter': 82.36321470495605, 'IoU-helmet': 43.359376759057035, 'IoU-holder': 0.0, 'IoU-hook': nan, 'IoU-horse': 87.05409154412557, 'IoU-horse-drawncarriage': 18.201481528147458, 'IoU-hot-airballoon': nan, 'IoU-hydrovalve': nan, 'IoU-ice': 52.56126998551671, 'IoU-inflatorpump': nan, 'IoU-ipod': 6.861332984156082, 'IoU-iron': 0.0, 'IoU-ironingboard': nan, 'IoU-jar': 45.440372710215996, 'IoU-kart': nan, 'IoU-kettle': 0.0, 'IoU-key': 0.0, 'IoU-keyboard': 44.97156022632734, 'IoU-kitchenrange': 7.78873095640534, 'IoU-kite': nan, 'IoU-knife': 21.45564472815996, 'IoU-knifeblock': 0.0, 'IoU-ladder': 34.42331275297186, 'IoU-laddertruck': 4.076086956521739, 'IoU-ladle': nan, 'IoU-laptop': 52.951582528400465, 'IoU-leaves': nan, 'IoU-lid': 0.0, 'IoU-lifebuoy': 0.03614153023239004, 'IoU-light': 40.98910620622143, 'IoU-lightbulb': 0.0, 'IoU-lighter': nan, 'IoU-line': 0.0, 'IoU-lion': nan, 'IoU-lobster': nan, 'IoU-lock': 0.0, 'IoU-machine': nan, 'IoU-mailbox': 0.0, 'IoU-mannequin': nan, 'IoU-map': 9.386670042407747, 'IoU-mask': nan, 'IoU-mat': 0.0, 'IoU-matchbook': 57.24225173940544, 'IoU-mattress': 0.0, 'IoU-menu': 25.387024370336857, 'IoU-metal': 6.258357673112074, 'IoU-meterbox': nan, 'IoU-microphone': 10.06660254432608, 'IoU-microwave': 13.234471585484634, 'IoU-mirror': 8.76853986149465, 'IoU-missile': nan, 'IoU-model': 0.0, 'IoU-money': 66.07264665757162, 'IoU-monkey': 0.0, 'IoU-mop': 0.0, 'IoU-motorbike': 84.17686986886278, 'IoU-mountain': 56.9483812342301, 'IoU-mouse': 44.2033501406908, 'IoU-mousepad': 13.61311020549727, 'IoU-musicalinstrument': 8.905377064204014, 'IoU-napkin': 11.439600389142692, 'IoU-net': 0.0, 'IoU-newspaper': 8.877598562332215, 'IoU-oar': 2.219972521512763, 'IoU-ornament': 0.26133400270537865, 'IoU-outlet': 4.864400482957184, 'IoU-oven': 36.742521787452056, 'IoU-oxygenbottle': 0.0, 'IoU-pack': 0.8027994499135385, 'IoU-pan': 19.817373709423585, 'IoU-paper': 29.423385541219748, 'IoU-paperbox': 0.0, 'IoU-papercutter': 0.0, 'IoU-parachute': 1.000721240533718, 'IoU-parasol': 31.733829407476303, 'IoU-parterre': 0.0, 'IoU-patio': 1.1642520112160186, 'IoU-pelage': nan, 'IoU-pen': 22.626819478698195, 'IoU-pencontainer': 0.0, 'IoU-pencil': 0.0, 'IoU-person': 86.33698783622864, 'IoU-photo': nan, 'IoU-piano': 20.87313809127952, 'IoU-picture': 9.524174350561882, 'IoU-pig': nan, 'IoU-pillar': 0.0640658066034476, 'IoU-pillow': 4.010521868108032, 'IoU-pipe': 0.0, 'IoU-pitcher': 0.0, 'IoU-plant': 6.62384787560959, 'IoU-plastic': 7.1616903212780105, 'IoU-plate': 30.282920996411484, 'IoU-platform': 52.843020845252944, 'IoU-player': 0.0, 'IoU-playground': 2.6362080441190456, 'IoU-pliers': 0.0, 'IoU-plume': 0.0, 'IoU-poker': 0.0, 'IoU-pokerchip': 0.0, 'IoU-pole': 8.941824668816965, 'IoU-pooltable': nan, 'IoU-postcard': 0.0, 'IoU-poster': 5.239850230027872, 'IoU-pot': 1.3751628693860298, 'IoU-pottedplant': 33.68644032745055, 'IoU-printer': 11.081860943120281, 'IoU-projector': nan, 'IoU-pumpkin': 16.527809052015314, 'IoU-rabbit': nan, 'IoU-racket': 61.00993377483444, 'IoU-radiator': 5.831960921144452, 'IoU-radio': 0.0, 'IoU-rail': 0.0005192952816830707, 'IoU-rake': nan, 'IoU-ramp': 23.241744391227627, 'IoU-rangehood': 0.0, 'IoU-receiver': 0.0, 'IoU-recorder': nan, 'IoU-recreationalmachines': nan, 'IoU-remotecontrol': 33.623296585515234, 'IoU-road': 51.38488702742106, 'IoU-robot': nan, 'IoU-rock': 55.14771426135806, 'IoU-rocket': nan, 'IoU-rockinghorse': 0.0, 'IoU-rope': 5.192098218941562, 'IoU-rug': 20.947991426896515, 'IoU-ruler': nan, 'IoU-runway': 0.41291650089279613, 'IoU-saddle': 6.179020535542928, 'IoU-sand': 14.002296779713525, 'IoU-saw': 0.0, 'IoU-scale': 0.0, 'IoU-scanner': 0.0, 'IoU-scissors': 11.262798634812286, 'IoU-scoop': 0.0, 'IoU-screen': nan, 'IoU-screwdriver': nan, 'IoU-sculpture': 33.66129819709465, 'IoU-scythe': nan, 'IoU-sewer': 0.0, 'IoU-sewingmachine': 0.0, 'IoU-shed': 0.0, 'IoU-sheep': 90.35284878333346, 'IoU-shell': 0.08000095523528639, 'IoU-shelves': 27.217059162930273, 'IoU-shoe': 28.447435689704793, 'IoU-shoppingcart': nan, 'IoU-shovel': nan, 'IoU-sidecar': 0.0, 'IoU-sidewalk': 15.270049475016853, 'IoU-sign': 38.235518935202826, 'IoU-signallight': 5.222701657588833, 'IoU-sink': 29.31618483382704, 'IoU-skateboard': nan, 'IoU-ski': 62.33905579399141, 'IoU-sky': 90.38459030487833, 'IoU-sled': 0.0, 'IoU-slippers': nan, 'IoU-smoke': 41.50310007531961, 'IoU-snail': nan, 'IoU-snake': nan, 'IoU-snow': 71.72334709410876, 'IoU-snowmobiles': 91.43113503813369, 'IoU-sofa': 62.9717336457838, 'IoU-spanner': nan, 'IoU-spatula': 1.8825056799740343, 'IoU-speaker': 28.42552535280535, 'IoU-speedbump': nan, 'IoU-spicecontainer': 0.0, 'IoU-spoon': 12.346052134491877, 'IoU-sprayer': nan, 'IoU-squirrel': 61.265202554904185, 'IoU-stage': 5.950433926446567, 'IoU-stair': 31.91084709197603, 'IoU-stapler': 0.0, 'IoU-stick': 0.07479479377093616, 'IoU-stickynote': 6.087907117008444, 'IoU-stone': nan, 'IoU-stool': 2.6217883093210816, 'IoU-stove': 3.0886153992079866, 'IoU-straw': 0.0, 'IoU-stretcher': nan, 'IoU-sun': 4.432776885836314, 'IoU-sunglass': 4.064973387385897, 'IoU-sunshade': 5.282908015806082, 'IoU-surveillancecamera': 0.0, 'IoU-swan': nan, 'IoU-sweeper': nan, 'IoU-swimring': 0.0, 'IoU-swimmingpool': nan, 'IoU-swing': 4.38281803162615, 'IoU-switch': 0.0, 'IoU-table': 46.43870160758634, 'IoU-tableware': 0.018034201332409225, 'IoU-tank': 54.669898759446745, 'IoU-tap': 2.5505519851311105, 'IoU-tape': 0.0, 'IoU-tarp': 15.9356676531551, 'IoU-telephone': 16.755028191534123, 'IoU-telephonebooth': nan, 'IoU-tent': 26.426394616638778, 'IoU-tire': 19.383434139555817, 'IoU-toaster': 0.0, 'IoU-toilet': nan, 'IoU-tong': nan, 'IoU-tool': 28.118894200789857, 'IoU-toothbrush': nan, 'IoU-towel': 5.418278293449677, 'IoU-toy': 33.19743362303708, 'IoU-toycar': 0.0, 'IoU-track': 5.304575089121734, 'IoU-train': 86.64790125192005, 'IoU-trampoline': nan, 'IoU-trashbin': 9.087434069169188, 'IoU-tray': 0.31973826077257683, 'IoU-tree': 67.55935282246266, 'IoU-tricycle': nan, 'IoU-tripod': 29.43544047695917, 'IoU-trophy': 3.73952126047874, 'IoU-truck': 9.459602185787261, 'IoU-tube': 0.0, 'IoU-turtle': nan, 'IoU-tvmonitor': 18.523096343721974, 'IoU-tweezers': nan, 'IoU-typewriter': nan, 'IoU-umbrella': 10.655798886351082, 'IoU-unknown': 0.3736364078008547, 'IoU-vacuumcleaner': 30.6874253655679, 'IoU-vendingmachine': nan, 'IoU-videocamera': 5.7228269201287745, 'IoU-videogameconsole': 1.5019343093377835, 'IoU-videoplayer': 0.0, 'IoU-videotape': 0.0, 'IoU-violin': 44.31818181818182, 'IoU-wakeboard': nan, 'IoU-wall': 56.75807605007611, 'IoU-wallet': 38.021920668058456, 'IoU-wardrobe': nan, 'IoU-washingmachine': 46.152170373076196, 'IoU-watch': 5.902805215329909, 'IoU-water': 85.29164089900442, 'IoU-waterdispenser': 0.5551751125024457, 'IoU-waterpipe': 0.0, 'IoU-waterskateboard': nan, 'IoU-watermelon': nan, 'IoU-whale': nan, 'IoU-wharf': nan, 'IoU-wheel': 0.0, 'IoU-wheelchair': 52.98275530130092, 'IoU-window': 30.159636770792563, 'IoU-windowblinds': nan, 'IoU-wineglass': 31.55574043261231, 'IoU-wire': 1.0958087079108605, 'IoU-wood': 23.413647074769198, 'IoU-wool': 0.0, 'mACC': 35.15316790064053, 'pACC': 69.39168057227016, 'ACC-accordion': nan, 'ACC-aeroplane': 88.67278467446313, 'ACC-airconditioner': 0.0, 'ACC-antenna': 0.0, 'ACC-artillery': 24.83740551942345, 'ACC-ashtray': 4.3478260869565215, 'ACC-atrium': nan, 'ACC-babycarriage': 73.54066928712236, 'ACC-bag': 46.79300158501748, 'ACC-ball': 78.44827586206897, 'ACC-balloon': 96.6677655073897, 'ACC-bambooweaving': 54.83251991824135, 'ACC-barrel': 0.0, 'ACC-baseballbat': nan, 'ACC-basket': 43.87410373029719, 'ACC-basketballbackboard': 45.15028778512044, 'ACC-bathtub': 71.96933153926223, 'ACC-bed': 68.85879349115757, 'ACC-bedclothes': 12.245770857754586, 'ACC-beer': 98.82898806893505, 'ACC-bell': 0.0, 'ACC-bench': 54.0069543236396, 'ACC-bicycle': 88.88585524914677, 'ACC-binoculars': nan, 'ACC-bird': 89.34621223467019, 'ACC-birdcage': 80.6438241355681, 'ACC-birdfeeder': 39.04479675669871, 'ACC-birdnest': 32.73020821734774, 'ACC-blackboard': 45.991544664526735, 'ACC-board': 0.3757354406578457, 'ACC-boat': 82.70539122642049, 'ACC-bone': 0.0, 'ACC-book': 61.53995297841468, 'ACC-bottle': 72.52008157688857, 'ACC-bottleopener': 0.0, 'ACC-bowl': 55.09175236942932, 'ACC-box': 45.4822306609427, 'ACC-bracelet': nan, 'ACC-brick': 49.66309649519787, 'ACC-bridge': 57.92331029448664, 'ACC-broom': 7.563784149920975, 'ACC-brush': 0.0, 'ACC-bucket': 34.03101105407765, 'ACC-building': 32.161353130096785, 'ACC-bus': 91.69755950851447, 'ACC-cabinet': 45.88329380386067, 'ACC-cabinetdoor': nan, 'ACC-cage': 37.129195687035455, 'ACC-cake': 97.81708272696741, 'ACC-calculator': 0.0, 'ACC-calendar': 31.91374036935228, 'ACC-camel': nan, 'ACC-camera': 63.3001614984166, 'ACC-cameralens': nan, 'ACC-can': 58.74072552108303, 'ACC-candle': 8.52367688022284, 'ACC-candleholder': 12.357927181660566, 'ACC-cap': 0.0, 'ACC-car': 79.00906232624479, 'ACC-card': 0.0, 'ACC-cart': 53.18786121265342, 'ACC-case': 4.721573376174374, 'ACC-casetterecorder': 0.0, 'ACC-cashregister': 0.0, 'ACC-cat': 98.12222040200326, 'ACC-cd': 14.403103896341577, 'ACC-cdplayer': 91.43308330043428, 'ACC-ceiling': 89.29819869182751, 'ACC-cellphone': 34.43104184457729, 'ACC-cello': 80.83982615843368, 'ACC-chain': 25.174711522834393, 'ACC-chair': 70.62929465341574, 'ACC-chessboard': nan, 'ACC-chicken': nan, 'ACC-chopstick': 70.00586805264481, 'ACC-clip': 0.0, 'ACC-clippers': 0.0, 'ACC-clock': 46.1066145687971, 'ACC-closet': nan, 'ACC-cloth': 4.3107323112218365, 'ACC-clothestree': nan, 'ACC-coffee': 0.0, 'ACC-coffeemachine': nan, 'ACC-comb': 0.0, 'ACC-computer': 60.25609588991699, 'ACC-concrete': 19.880863737900224, 'ACC-cone': 65.73142188414278, 'ACC-container': 1.2542359013520794, 'ACC-controlbooth': nan, 'ACC-controller': 0.0, 'ACC-cooker': nan, 'ACC-copyingmachine': nan, 'ACC-coral': nan, 'ACC-cork': nan, 'ACC-corkscrew': nan, 'ACC-counter': 36.238292765646605, 'ACC-court': nan, 'ACC-cow': 97.08104462916585, 'ACC-crabstick': nan, 'ACC-crane': 59.787977352126255, 'ACC-crate': 0.0, 'ACC-cross': 58.457711442786064, 'ACC-crutch': 0.0, 'ACC-cup': 59.373629040538404, 'ACC-curtain': 77.24865020763487, 'ACC-cushion': 5.335413930289025, 'ACC-cuttingboard': 0.0, 'ACC-dais': 26.288874353332936, 'ACC-disc': 0.0, 'ACC-disccase': 0.0, 'ACC-dishwasher': nan, 'ACC-dock': nan, 'ACC-dog': 96.38515312144722, 'ACC-dolphin': nan, 'ACC-door': 58.27061400874196, 'ACC-drainer': nan, 'ACC-dray': nan, 'ACC-drinkdispenser': nan, 'ACC-drinkingmachine': 0.0, 'ACC-drop': nan, 'ACC-drug': 62.916228531370486, 'ACC-drum': 0.0, 'ACC-drumkit': 52.33608166470357, 'ACC-duck': 53.86411359598243, 'ACC-dumbbell': nan, 'ACC-earphone': 1.660682226211849, 'ACC-earrings': nan, 'ACC-egg': 84.45320353420453, 'ACC-electricfan': 6.516044531761624, 'ACC-electriciron': 0.0, 'ACC-electricpot': 0.0, 'ACC-electricsaw': nan, 'ACC-electronickeyboard': nan, 'ACC-engine': 0.0, 'ACC-envelope': nan, 'ACC-equipment': 38.06020066889632, 'ACC-escalator': nan, 'ACC-exhibitionbooth': 5.11396192780289, 'ACC-extinguisher': 68.51196670135276, 'ACC-eyeglass': 0.0, 'ACC-fan': 43.13730718466277, 'ACC-faucet': 54.98151082937137, 'ACC-faxmachine': nan, 'ACC-fence': 51.68244496861557, 'ACC-ferriswheel': 61.07588247727753, 'ACC-fireextinguisher': nan, 'ACC-firehydrant': nan, 'ACC-fireplace': 64.1382264029436, 'ACC-fish': 76.50376917078243, 'ACC-fishtank': 89.95939573540952, 'ACC-fishbowl': 0.0, 'ACC-fishingnet': 72.97315898141775, 'ACC-fishingpole': 0.0, 'ACC-flag': 82.18945221197569, 'ACC-flagstaff': 0.0, 'ACC-flame': nan, 'ACC-flashlight': 0.0, 'ACC-floor': 69.23657528731817, 'ACC-flower': 55.8690276009405, 'ACC-fly': 17.05521472392638, 'ACC-foam': nan, 'ACC-food': 32.81528684605036, 'ACC-footbridge': nan, 'ACC-forceps': nan, 'ACC-fork': 30.92647667808606, 'ACC-forklift': nan, 'ACC-fountain': 0.11355034065102196, 'ACC-fox': nan, 'ACC-frame': 0.0, 'ACC-fridge': 74.25905004375846, 'ACC-frog': nan, 'ACC-fruit': 0.0, 'ACC-funnel': nan, 'ACC-furnace': 0.0, 'ACC-gamecontroller': 70.30630630630631, 'ACC-gamemachine': 45.80649535561733, 'ACC-gascylinder': nan, 'ACC-gashood': nan, 'ACC-gasstove': nan, 'ACC-giftbox': 67.94644615081708, 'ACC-glass': 2.3748366042944506, 'ACC-glassmarble': 0.3993714809480162, 'ACC-globe': nan, 'ACC-glove': 69.130476464385, 'ACC-goal': 76.2369536565383, 'ACC-grandstand': 22.468300238964435, 'ACC-grass': 85.70658888276226, 'ACC-gravestone': nan, 'ACC-ground': 20.93869534425283, 'ACC-guardrail': 18.119013653963727, 'ACC-guitar': 80.08163443625118, 'ACC-gun': 88.3674981476908, 'ACC-hammer': 41.55844155844156, 'ACC-handcart': 0.0, 'ACC-handle': 0.0, 'ACC-handrail': 12.554245685973006, 'ACC-hanger': 0.0, 'ACC-harddiskdrive': nan, 'ACC-hat': 91.63523600612307, 'ACC-hay': 98.62403616059558, 'ACC-headphone': 5.971014492753623, 'ACC-heater': 0.0, 'ACC-helicopter': 83.2836339422715, 'ACC-helmet': 61.261158086948775, 'ACC-holder': 0.0, 'ACC-hook': nan, 'ACC-horse': 95.39722643361296, 'ACC-horse-drawncarriage': 18.48485010050171, 'ACC-hot-airballoon': nan, 'ACC-hydrovalve': nan, 'ACC-ice': 60.327642292322636, 'ACC-inflatorpump': nan, 'ACC-ipod': 7.314349525404802, 'ACC-iron': 0.0, 'ACC-ironingboard': nan, 'ACC-jar': 80.61134247720732, 'ACC-kart': nan, 'ACC-kettle': 0.0, 'ACC-key': 0.0, 'ACC-keyboard': 50.05320049776522, 'ACC-kitchenrange': 21.766421506467157, 'ACC-kite': nan, 'ACC-knife': 25.22005772005772, 'ACC-knifeblock': 0.0, 'ACC-ladder': 78.80115535650538, 'ACC-laddertruck': 78.10271041369472, 'ACC-ladle': nan, 'ACC-laptop': 63.62353009875984, 'ACC-leaves': nan, 'ACC-lid': 0.0, 'ACC-lifebuoy': 0.18201674554058975, 'ACC-light': 62.89047634028743, 'ACC-lightbulb': 0.0, 'ACC-lighter': nan, 'ACC-line': 0.0, 'ACC-lion': nan, 'ACC-lobster': nan, 'ACC-lock': 0.0, 'ACC-machine': nan, 'ACC-mailbox': 0.0, 'ACC-mannequin': nan, 'ACC-map': 94.53386454183267, 'ACC-mask': nan, 'ACC-mat': 0.0, 'ACC-matchbook': 63.06620209059234, 'ACC-mattress': 0.0, 'ACC-menu': 25.652380482819826, 'ACC-metal': 29.919705530290706, 'ACC-meterbox': nan, 'ACC-microphone': 23.32828665152662, 'ACC-microwave': 89.0155507629441, 'ACC-mirror': 18.44321533529967, 'ACC-missile': nan, 'ACC-model': 0.0, 'ACC-money': 90.69522471910112, 'ACC-monkey': 0.0, 'ACC-mop': 0.0, 'ACC-motorbike': 92.07658922092564, 'ACC-mountain': 66.78075952533746, 'ACC-mouse': 58.27710693389767, 'ACC-mousepad': 13.704927954561327, 'ACC-musicalinstrument': 18.58335478651024, 'ACC-napkin': 16.64996770614246, 'ACC-net': 0.0, 'ACC-newspaper': 45.593764955219804, 'ACC-oar': 6.388513162001873, 'ACC-ornament': 48.15005138746146, 'ACC-outlet': 14.646252796420582, 'ACC-oven': 41.76108573585255, 'ACC-oxygenbottle': 0.0, 'ACC-pack': 0.8375023792681229, 'ACC-pan': 70.34952727868047, 'ACC-paper': 53.57928152191289, 'ACC-paperbox': 0.0, 'ACC-papercutter': 0.0, 'ACC-parachute': 1.151691222245279, 'ACC-parasol': 53.247564010629766, 'ACC-parterre': 0.0, 'ACC-patio': 38.839645447219986, 'ACC-pelage': nan, 'ACC-pen': 41.451098511693836, 'ACC-pencontainer': 0.0, 'ACC-pencil': 0.0, 'ACC-person': 96.41347053105994, 'ACC-photo': nan, 'ACC-piano': 77.02926976463488, 'ACC-picture': 16.099941001052162, 'ACC-pig': nan, 'ACC-pillar': 1.2907838783727845, 'ACC-pillow': 4.563619165288702, 'ACC-pipe': 0.0, 'ACC-pitcher': 0.0, 'ACC-plant': 48.677194948731355, 'ACC-plastic': 86.8474599167518, 'ACC-plate': 40.7113303698232, 'ACC-platform': 68.34485671493049, 'ACC-player': 0.0, 'ACC-playground': 72.5649654140961, 'ACC-pliers': 0.0, 'ACC-plume': 0.0, 'ACC-poker': 0.0, 'ACC-pokerchip': 0.0, 'ACC-pole': 9.38376774879487, 'ACC-pooltable': nan, 'ACC-postcard': 0.0, 'ACC-poster': 6.379449209710786, 'ACC-pot': 4.428531653255989, 'ACC-pottedplant': 37.322683585340585, 'ACC-printer': 31.34475202361254, 'ACC-projector': nan, 'ACC-pumpkin': 98.35761407366685, 'ACC-rabbit': nan, 'ACC-racket': 82.67893201705184, 'ACC-radiator': 76.67155963302751, 'ACC-radio': 0.0, 'ACC-rail': 0.008082477189453265, 'ACC-rake': nan, 'ACC-ramp': 93.46962912900229, 'ACC-rangehood': 0.0, 'ACC-receiver': 0.0, 'ACC-recorder': nan, 'ACC-recreationalmachines': nan, 'ACC-remotecontrol': 36.0603074901985, 'ACC-road': 81.98014241266915, 'ACC-robot': nan, 'ACC-rock': 76.26764743363024, 'ACC-rocket': nan, 'ACC-rockinghorse': 0.0, 'ACC-rope': 5.32954885060462, 'ACC-rug': 61.43174829483188, 'ACC-ruler': nan, 'ACC-runway': 98.26960466623461, 'ACC-saddle': 7.035094719641262, 'ACC-sand': 96.10984462408678, 'ACC-saw': 0.0, 'ACC-scale': 0.0, 'ACC-scanner': 0.0, 'ACC-scissors': 35.685828116107, 'ACC-scoop': 0.0, 'ACC-screen': nan, 'ACC-screwdriver': nan, 'ACC-sculpture': 49.99706899583797, 'ACC-scythe': nan, 'ACC-sewer': 0.0, 'ACC-sewingmachine': 0.0, 'ACC-shed': 0.0, 'ACC-sheep': 95.97510805058931, 'ACC-shell': 9.241379310344827, 'ACC-shelves': 43.39967723035301, 'ACC-shoe': 61.970413764764146, 'ACC-shoppingcart': nan, 'ACC-shovel': nan, 'ACC-sidecar': 0.0, 'ACC-sidewalk': 82.20043633354209, 'ACC-sign': 48.76171157717749, 'ACC-signallight': 15.29942670319803, 'ACC-sink': 32.67077111655895, 'ACC-skateboard': nan, 'ACC-ski': 67.4931129476584, 'ACC-sky': 96.86060859786092, 'ACC-sled': 0.0, 'ACC-slippers': nan, 'ACC-smoke': 59.26904713992389, 'ACC-snail': nan, 'ACC-snake': nan, 'ACC-snow': 87.97007973240903, 'ACC-snowmobiles': 98.94164481988543, 'ACC-sofa': 76.88573527049267, 'ACC-spanner': nan, 'ACC-spatula': 2.449324324324324, 'ACC-speaker': 35.78333512593226, 'ACC-speedbump': nan, 'ACC-spicecontainer': 0.0, 'ACC-spoon': 16.09640769685427, 'ACC-sprayer': nan, 'ACC-squirrel': 66.13771606687446, 'ACC-stage': 7.6131903468350846, 'ACC-stair': 73.90955479682329, 'ACC-stapler': 0.0, 'ACC-stick': 22.8515625, 'ACC-stickynote': 69.49225473321859, 'ACC-stone': nan, 'ACC-stool': 11.460067123250294, 'ACC-stove': 7.015512226650868, 'ACC-straw': 0.0, 'ACC-stretcher': nan, 'ACC-sun': 95.41027351567712, 'ACC-sunglass': 79.81949458483754, 'ACC-sunshade': 22.899038856485664, 'ACC-surveillancecamera': 0.0, 'ACC-swan': nan, 'ACC-sweeper': nan, 'ACC-swimring': 0.0, 'ACC-swimmingpool': nan, 'ACC-swing': 53.13304721030043, 'ACC-switch': 0.0, 'ACC-table': 66.79917108038605, 'ACC-tableware': 13.481873111782477, 'ACC-tank': 77.57992715499797, 'ACC-tap': 2.9898936868355426, 'ACC-tape': 0.0, 'ACC-tarp': 44.44643674181063, 'ACC-telephone': 20.54215044296484, 'ACC-telephonebooth': nan, 'ACC-tent': 40.62137631332857, 'ACC-tire': 30.75208793110909, 'ACC-toaster': 0.0, 'ACC-toilet': nan, 'ACC-tong': nan, 'ACC-tool': 45.189738107963656, 'ACC-toothbrush': nan, 'ACC-towel': 47.62748193497876, 'ACC-toy': 37.803460231308094, 'ACC-toycar': 0.0, 'ACC-track': 6.134669555902052, 'ACC-train': 94.6164026862445, 'ACC-trampoline': nan, 'ACC-trashbin': 20.634020690717175, 'ACC-tray': 0.3828091963232512, 'ACC-tree': 78.77881900392298, 'ACC-tricycle': nan, 'ACC-tripod': 49.767103347889375, 'ACC-trophy': 51.85574229691877, 'ACC-truck': 55.66579974214846, 'ACC-tube': 0.0, 'ACC-turtle': nan, 'ACC-tvmonitor': 18.732756780104005, 'ACC-tweezers': nan, 'ACC-typewriter': nan, 'ACC-umbrella': 41.49155695062051, 'ACC-unknown': 0.37503682555097484, 'ACC-vacuumcleaner': 37.92709754671271, 'ACC-vendingmachine': nan, 'ACC-videocamera': 11.931091792380466, 'ACC-videogameconsole': 8.874281018898932, 'ACC-videoplayer': 0.0, 'ACC-videotape': 0.0, 'ACC-violin': 65.14722536806342, 'ACC-wakeboard': nan, 'ACC-wall': 77.74897382386253, 'ACC-wallet': 40.371293987254084, 'ACC-wardrobe': nan, 'ACC-washingmachine': 49.262933889538736, 'ACC-watch': 9.970635344367325, 'ACC-water': 89.13261390281083, 'ACC-waterdispenser': 1.561640066042928, 'ACC-waterpipe': 0.0, 'ACC-waterskateboard': nan, 'ACC-watermelon': nan, 'ACC-whale': nan, 'ACC-wharf': nan, 'ACC-wheel': 0.0, 'ACC-wheelchair': 86.95102685624012, 'ACC-window': 54.07234242165261, 'ACC-windowblinds': nan, 'ACC-wineglass': 39.33098576646506, 'ACC-wire': 1.7468192504494537, 'ACC-wood': 43.76254799941072, 'ACC-wool': 0.0})])
[05/02 16:15:30 d2.engine.defaults]: Evaluation results for context_459_test_sem_seg in csv format:
[05/02 16:15:30 d2.evaluation.testing]: copypaste: Task: sem_seg
[05/02 16:15:30 d2.evaluation.testing]: copypaste: mIoU,fwIoU,mACC,pACC
[05/02 16:15:30 d2.evaluation.testing]: copypaste: 14.6468,58.8596,35.1532,69.3917
lchen1019 commented 6 months ago

I solved it and found that it was caused by the Detectron version. I tried different versions and the problem was solved. QQ截图20240514104417

Kimsure commented 1 month ago

which version of Detectron2 can get the best result?

lchen1019 commented 1 month ago

I use detectron2==0.6, which does not consider classes that do not appear, so the mIoU will be slightly higher in some cases. Hope this helps.