search

fyu / drn

Dilated Residual Networks
https://www.vis.xyz/pub/drn
BSD 3-Clause "New" or "Revised" License
1.1k stars 219 forks source link

Problems about the test results and the number of categories for Cityscapes #10

Closed qxr04025 closed 7 years ago

qxr04025 commented 7 years ago

Hi, @fyu ,

Thanks for your code. When I downloaded the Cityscapes dataset, I found the number of classes is 30， not 19 in the README.md. So I can't reproduce the mAP of the validation set. I am so confused.

And I am also confused about the difference between IOUclass and IOU category in the evaluation for Cityscapes.

Thanks.

pranav-sankhe commented 7 years ago

Hi @fyu, The number of labels in Cityscapes dataset is 34 (35 if you include the -1 label of the license plate). Attached pic is the output of the helper scripts given by Cityscape creators. Link to the script

screenshot from 2017-10-26 04-52-03

Due to this mismatch of the number of labels, the code in which I am running a validation phase spits out the following error when it calculates the loss. screenshot from 2017-10-26 05-01-06

Please look into this.

fyu commented 7 years ago

The model is trained with 19 labels, i.e. categories with valid trainId, following the official segmentation evaluation protocal of cityscapes.