IGNF / myria3d

Myria3D: Aerial Lidar HD Semantic Segmentation with Deep Learning
https://ignf.github.io/myria3d/
BSD 3-Clause "New" or "Revised" License
151 stars 20 forks source link

Macro averaging of metrics #130

Open Vynikal opened 1 month ago

Vynikal commented 1 month ago

In metric_callbacks.py, lines 34-36 def _metrics_factory(self, by_class=False): average = None if by_class else "micro" average_iou = None if by_class else "macro" # special case, only mean IoU is of interest

This results in equal metrics of overall accuracy, recall, precision and f1-score. Wouldn't it be better to average 'macro', as the resulting metrics would be unambiguous? (except for accuracy)