search

rishizek / tensorflow-deeplab-v3

DeepLabv3 built in TensorFlow
MIT License
286 stars 102 forks source link

test accuracy? #4

Open iliadsouti opened 6 years ago

iliadsouti commented 6 years ago

Thanks for your great project. I wonder what is the test set accuracy?

rishizek commented 6 years ago

Hi @iliadsouti , Thanks for interesting in the repo. I also wonder. But the test set mIoU is not easily computable because I don't have the test set grandtruth labels and probably need to submit the evaluated result to PASCAL VOC Challenge performace evaluation server. It should be similar value to the validation set and I don't feel necessity to spend time for that.

iliadsouti commented 6 years ago

Hi, In tensorflow implmentation of deeplab-v2 there is around 10% performance gap in test/validation. Some images may be both present in validation/training set. Refer to this link. You will need to submit the result to test server. That's a standard cross implmentation validation.

rishizek commented 6 years ago

I see. OK. I'll try when I have time. Thank you for your suggestion.