NVIDIA / semantic-segmentation

Nvidia Semantic Segmentation monorepo
BSD 3-Clause "New" or "Revised" License
1.76k stars 388 forks source link

multi-scale inference #159

Open ed-Im opened 2 years ago

ed-Im commented 2 years ago

Is it right to improve the performance of the mIOU depending on whether multi_scale_inferance is used or not among config file options? The custom data set that I'm experimenting with showed worse performance. Can you explain the multi_scale_inferance function in detail? I'd like to know if it's the multi-scale information function I think.

[0.5, 1.0] multi scale

IoU:
Id  label               iU_1.0     TP    FP    FN    Precision    Recall

---

0  Pillar               70.17   0.98  0.27  0.15         0.78      0.87
1  Stopper-Occluded     19.84   0.00  3.85  0.19         0.21      0.84
2  Line                 49.38   0.88  0.97  0.05         0.51      0.95
3  RoadMarker           32.76   1.41  0.14  1.91         0.88      0.34
4  Vehicle              85.60   4.71  0.03  0.13         0.97      0.88
5  Bump                 32.34   0.13  1.87  0.23         0.35      0.82
6  DisableMark          66.81   0.10  0.30  0.20         0.77      0.83
7  Ego-Vehicle          96.81  17.23  0.01  0.02         0.99      0.98
8  Pedestrian           62.99   0.15  0.38  0.21         0.72      0.83
9  ImpassableStep2      20.17   0.00  3.33  0.63         0.23      0.61
10  PassableStep         42.44   0.05  1.01  0.34         0.50      0.74
11  Stopper              66.94   0.06  0.33  0.17         0.75      0.86
12  Freespace            92.04  38.74  0.06  0.02         0.94      0.98
13  ImpassableStep       44.46   0.07  0.50  0.75         0.67      0.57
14  Background           94.46  29.82  0.03  0.02         0.97      0.98
Mean: 58.48

[0.5, 1.0] no multi scale

IoU:
Id  label               iU_1.0     TP    FP    FN    Precision    Recall

---

0  Pillar               71.73   1.04  0.21  0.18         0.83      0.84
1  Stopper-Occluded     26.45   0.01  2.49  0.29         0.29      0.77
2  Line                 55.18   1.00  0.74  0.07         0.57      0.93
3  RoadMarker           36.47   1.41  0.14  1.60         0.87      0.38
4  Vehicle              89.51   4.71  0.03  0.08         0.97      0.92
5  Bump                 41.42   0.17  1.18  0.23         0.46      0.81
6  DisableMark          66.78   0.10  0.24  0.25         0.80      0.80
7  Ego-Vehicle          97.82  17.23  0.01  0.01         0.99      0.99
8  Pedestrian           63.61   0.15  0.36  0.22         0.74      0.82
9  ImpassableStep2      25.56   0.01  2.11  0.80         0.32      0.56
10  PassableStep         44.62   0.05  0.79  0.45         0.56      0.69
11  Stopper              69.05   0.06  0.21  0.23         0.82      0.81
12  Freespace            93.42  39.28  0.05  0.02         0.95      0.98
13  ImpassableStep       43.52   0.08  0.40  0.90         0.72      0.53
14  Background           95.02  29.93  0.03  0.02         0.97      0.98
Mean: 61.35