OpenDroneMap / ODMSemantic3D

An open photogrammetry dataset of classified 3D point clouds for automated semantic segmentation. CC BY-SA 4.0
Other
15 stars 7 forks source link

Added toledo dataset #17

Closed HeDo88TH closed 1 year ago

u4gbot commented 1 year ago
Comparison for brighton_beach_small (Differences) Accuracy: 94.11% vs 96.70% | Label | Accuracy | Recall | Precision | F1 | | -------------------- | ---------- | ---------- | ---------- | ---------- | | | 14.64% | 99.56% | 14.65% | 0.26 | | building | 19.66% | 41.96% | 26.99% | 0.33 | | | 5.02% | -57.59% | 12.34% | 0.07 | | | | | | | | | 45.35% | 83.98% | 49.64% | 0.62 | | human_made_object | 39.18% | 39.45% | 98.30% | 0.56 | | | -6.17% | -44.54% | 48.66% | -0.06 | | | | | | | | | 66.95% | 95.07% | 69.36% | 0.80 | | low_vegetation | 41.25% | 47.70% | 75.33% | 0.58 | | | -25.70% | -47.37% | 5.97% | -0.22 | | | | | | | | | 94.06% | 94.12% | 99.93% | 0.97 | | ground | 97.01% | 99.09% | 97.88% | 0.98 | | | 2.95% | 4.97% | -2.05% | 0.02 | | | | | | |
Comparison for sheffield_park_small (Differences) Accuracy: 97.85% vs 30.80% | Label | Accuracy | Recall | Precision | F1 | | -------------------- | ---------- | ---------- | ---------- | ---------- | | | 92.46% | 94.00% | 98.27% | 0.96 | | building | 24.10% | 30.69% | 52.89% | 0.39 | | | -68.36% | -63.30% | -45.38% | -0.57 | | | | | | | | | 34.76% | 94.35% | 35.50% | 0.52 | | human_made_object | 1.70% | 1.86% | 16.49% | 0.03 | | | -33.06% | -92.49% | -19.02% | -0.48 | | | | | | | | | 95.84% | 98.10% | 97.66% | 0.98 | | low_vegetation | 20.29% | 99.97% | 20.29% | 0.34 | | | -75.56% | 1.87% | -77.37% | -0.64 | | | | | | | | | 98.04% | 98.33% | 99.70% | 0.99 | | ground | 15.15% | 15.39% | 90.57% | 0.26 | | | -82.89% | -82.93% | -9.13% | -0.73 | | | | | | |

Average (2 datasets)

Accuracy: 95.98% vs 63.75%

Label Accuracy Recall Precision F1
53.55% 96.78% 56.46% 0.61
building 21.88% 36.33% 39.94% 0.36
-31.67% -60.45% -16.52% -0.25
40.06% 89.17% 42.57% 0.57
human_made_object 20.44% 20.65% 57.39% 0.30
-19.61% -68.51% 14.82% -0.27
81.40% 96.58% 83.51% 0.89
low_vegetation 30.77% 73.84% 47.81% 0.46
-50.63% -22.75% -35.70% -0.43
96.05% 96.22% 99.82% 0.98
ground 56.08% 57.24% 94.23% 0.62
-39.97% -38.98% -5.59% -0.36