search

sacmehta / ESPNet

ESPNet: Efficient Spatial Pyramid of Dilated Convolutions for Semantic Segmentation
https://sacmehta.github.io/ESPNet/
MIT License
541 stars 112 forks source link

Why mIoU is lower than the result provided by the author? #26

Closed wangq95 closed 5 years ago

wangq95 commented 5 years ago

I use the pretrained model provided by the author to evaluate the validation data (500 images) of cityscapes dataset, and the mIoU result is only 54%, but the result provided by the author is 60% (on test data of cityscapes), will the gap be so big?

sacmehta commented 5 years ago

The scripts provided by the Cityscapes team for computing mIOU are different than ours. We don’t mask the background and unmarked areas while the CityScapes does. If you use their scripts, you should be able to get the reported accuracy.