search

LikeLy-Journey / SegmenTron

Support PointRend, Fast_SCNN, HRNet, Deeplabv3_plus(xception, resnet, mobilenet), ContextNet, FPENet, DABNet, EdaNet, ENet, Espnetv2, RefineNet, UNet, DANet, HRNet, DFANet, HardNet, LedNet, OCNet, EncNet, DuNet, CGNet, CCNet, BiSeNet, PSPNet, ICNet, FCN, deeplab)
Apache License 2.0
705 stars 162 forks source link

can't achieve 89.56 mIoU with your modelzoo. #28

Closed whitesockcat closed 4 years ago

whitesockcat commented 4 years ago 
python ./tools/eval.py --config-file configs/pascal_voc_deeplabv3_plus.yaml \
TEST.TEST_MODEL_PATH weights/deeplabv3_plus_xception_pascal_aug_segmentron.pth \
TEST.BATCH_SIZE 1

2020-03-18 10:41:21---Congratulations, the task is accomplished 2020-03-18 10:41:20---The training is finished, and output file is producing ......... 2020-03-18 10:41:20---The training is completed and the files are transferred. 2020-03-18 10:41:09---| 4 | boat | 0.694096 | 2020-03-18 10:41:09---+------------+--------------+----------+ 2020-03-18 10:41:09---| 5 | bottle | 0.889787 | 2020-03-18 10:41:09---+------------+--------------+----------+ 2020-03-18 10:41:09---| 6 | bus | 0.946816 | 2020-03-18 10:41:09---+------------+--------------+----------+ 2020-03-18 10:41:09---| 7 | car | 0.910226 | 2020-03-18 10:41:09---+------------+--------------+----------+ 2020-03-18 10:41:09---| 8 | cat | 0.934975 | 2020-03-18 10:41:09---+------------+--------------+----------+ 2020-03-18 10:41:09---| 9 | chair | 0.578426 | 2020-03-18 10:41:09---+------------+--------------+----------+ 2020-03-18 10:41:09---| 10 | cow | 0.941479 | 2020-03-18 10:41:09---+------------+--------------+----------+ 2020-03-18 10:41:09---| 11 | diningtable | 0.657297 | 2020-03-18 10:41:09---+------------+--------------+----------+ 2020-03-18 10:41:09---| 12 | dog | 0.920236 | 2020-03-18 10:41:09---+------------+--------------+----------+ 2020-03-18 10:41:09---| 13 | horse | 0.918536 | 2020-03-18 10:41:09---+------------+--------------+----------+ 2020-03-18 10:41:09---| 14 | motorcycle | 0.885518 | 2020-03-18 10:41:09---+------------+--------------+----------+ 2020-03-18 10:41:09---| 15 | person | 0.882771 | 2020-03-18 10:41:09---+------------+--------------+----------+ 2020-03-18 10:41:09---| 16 | potted-plant | 0.739484 | 2020-03-18 10:41:09---+------------+--------------+----------+ 2020-03-18 10:41:09---| 17 | sheep | 0.919957 | 2020-03-18 10:41:09---+------------+--------------+----------+ 2020-03-18 10:41:09---| 18 | sofa | 0.723864 | 2020-03-18 10:41:09---+------------+--------------+----------+ 2020-03-18 10:41:09---| 19 | train | 0.886305 | 2020-03-18 10:41:09---+------------+--------------+----------+ 2020-03-18 10:41:09---| 20 | tv | 0.797698 | 2020-03-18 10:41:09---+------------+--------------+----------+ 2020-03-18 10:41:09---2020-03-18 10:41:09,562 Segmentron INFO: Category iou: 2020-03-18 10:41:09---+------------+--------------+----------+ 2020-03-18 10:41:09---| class id | class name | iou | 2020-03-18 10:41:09---+============+==============+==========+ 2020-03-18 10:41:09---| 0 | background | 0.952956 | 2020-03-18 10:41:09---+------------+--------------+----------+ 2020-03-18 10:41:09---| 1 | airplane | 0.882033 | 2020-03-18 10:41:09---+------------+--------------+----------+ 2020-03-18 10:41:09---| 2 | bicycle | 0.412242 | 2020-03-18 10:41:09---+------------+--------------+----------+ 2020-03-18 10:41:09---| 3 | bird | 0.892831 | 2020-03-18 10:41:09---+------------+--------------+----------+ 2020-03-18 10:41:09---2020-03-18 10:41:09,554 Segmentron INFO: Eval use time: 453.290 second 2020-03-18 10:41:09---2020-03-18 10:41:09,555 Segmentron INFO: End validation pixAcc: 95.921, mIoU: 82.703

LikeLy-Journey commented 4 years ago

you should use configs/pascal_aug_deeplabv3_plus.yaml for deeplabv3_plus_xception_pascal_aug_segmentron.pth, and miou 89.56 was get by using 'val' mode not (mode='testval') here: https://github.com/LikeLy-Journey/SegmenTron/blob/master/tools/eval.py#L39