hellochick / PSPNet-tensorflow

TensorFlow-based implementation of "Pyramid Scene Parsing Network".
326 stars 123 forks source link

Mean image #10

Open FengLoveBella opened 6 years ago

FengLoveBella commented 6 years ago

May be the mean image in your code is fault. The mean image is Pascal.

hellochick commented 6 years ago

Yes, @zhoufengbuaa . I know the mean of image I used is for Pascal. But I think image mean is used for shifting the RGB value to -128~128. So the value of mean to subtract may have a small influence. Do you agree what I say ? Thanks

FengLoveBella commented 6 years ago

Agree

FengLoveBella commented 6 years ago

@hellochick I use your code and your model, but I got only 0.576 accuracy. Did you really got 77.23% accuracy on validation dataset of cityscape dataset ??

FengLoveBella commented 6 years ago

screenshot from 2017-12-12 09-39-09

FengLoveBella commented 6 years ago

And it is much poor than deeplab v2, I used deeplab v2, I got 70+ accuracy. @hellochick

John1231983 commented 6 years ago

@zhoufengbuaa : Very nice report. Could you tell me how did you achieve the report? Thanks

FengLoveBella commented 6 years ago

please refer to the python code provided by cituscape dataset. @John1231983

FengLoveBella commented 6 years ago

what IOU did you get, I used the model I only get IOU about 0.5~0.6 per 10 steps. @hellochick @John1231983

John1231983 commented 6 years ago

@zhoufengbuaa : Mee too. When I used hellochick code I only got around 60% IoU. I guess something wrong when I run the code. But my question is how could you generate the nice report as the figure? Do you use some script or python code for making the report?

hellochick commented 6 years ago

@zhoufengbuaa @John1231983 , Did you run the evaluate.py with trainIdLabelImg ? You should first transform the images using this script: https://github.com/mcordts/cityscapesScripts/blob/master/cityscapesscripts/preparation/createTrainIdLabelImgs.py Please tell me your evaluation procedure, thanks. Btw, I really got that result ( Without filpping ): default

FengLoveBella commented 6 years ago

I am sorry, it's my fault, I should not doubt your code, and I got your accuracy, and it's about 0.77. The reason is caused by mean image. Thank you very much.

screenshot from 2017-12-12 16-38-11

FengLoveBella commented 6 years ago

please refer to the evaluation python code provided by cityscape dataset, you just need put you predition result to this code, and it will give you this output. @John1231983

smmdream commented 6 years ago

2017-12-14 16-00-49 @hellochick @zhoufengbuaa This is my evaluation result, the mIoU is gradually increasing, only 0.502 at the beginning , is it right or normal?

hellochick commented 6 years ago

@smmdream , yes it's normal. Since not all objects appear in the beginning (One image may not contain 19 classes together), so the mIoU will gradually increase.

smmdream commented 6 years ago

@hellochick , I find a problem that the same model, the first evaluation result is different from the second evaluation result and the third and so on, and their value are quite different. Usually the first evaluation result is better. 2017-12-14 20-51-42 2017-12-14 20-52-46 2017-12-14 20-53-39

hellochick commented 6 years ago

Hey, since you use different part of queue, the result will be different. But if you run the whole evaluation data, the result will be the same.

smmdream commented 6 years ago

@hellochick , oh I see, I do the test, you are right.

smmdream commented 6 years ago

@zhoufengbuaa I want to get the mIoU of each category, such as yours, can you tell me how to get that?

rydeldcosta commented 6 years ago

@zhoufengbuaa Hey, you said you made a mistake with the mean image which caused you to get low mIoU. Can you please elaborate ? I am facing the same issue

FengLoveBella commented 6 years ago

@rydeldcosta mean image, just use the mean image provided in this code.

xlmou commented 6 years ago

@zhoufengbuaa Hi friends, where can I get an initial model pretrained on ImageNet to train PSPnet ? Can you give me a download link ?

ga84 commented 5 years ago

@zhoufengbuaa @hellochick I know it's been a long time since you posted here, but could you please give me some advice on how to get images with (class - or training) label IDs? In order to evaluate with cityscapes scripts you must have had these, right? So can you please tell me in which way you got them? I tried with this code by getting IDs as: IDs = sess.run(raw_output_up) however this gives an image with numbers which don't represent neither train IDs, nor class labels (numbers up to 255, but don't fit to these two IDs)....

LbinB commented 5 years ago

Did you get a solution about the problem? @ga84

Jason-xin commented 5 years ago

@zhoufengbuaa I want to get the mIoU of each category, such as yours, can you tell me how to get that?

So do I? Have you solved yet?