search

e-lab / LinkNet

166 stars 42 forks source link

About IoU #10

Closed qqning closed 6 years ago

qqning commented 7 years ago

Hi, @codeAC29
I cannot obtain the high IoU in my training. I looked into your code and found that, the IoU is computed via averageValid. But this is actually computing the mean of class accuracy. The IoU should be the value of averageUnionValid. Do you notice the difference and obtain 76% IoU by averageUnionValid ?

Sorry for the trouble. For convenience, I refer the definition of averageValid and averageUnionValid here.

AnzoChou commented 7 years ago

@qqning After checking the definition of metrics, I think you are right. The author may reported wrong numbers. The mean IoU(76.4%) in paper is actually the mean class accuracy and the iIOU(58.6%) is actually the mean IoU.

codeAC29 commented 6 years ago

@qqning the displayed values after each epoch are incorrect. Thank you for pointing it out. We did not use optim to calculate the values reported in the paper; instead we modified cityscapes script to calculate IoU and iIoU since optim package does not give us iIoU values.