search

open-mmlab / mmsegmentation

OpenMMLab Semantic Segmentation Toolbox and Benchmark.
https://mmsegmentation.readthedocs.io/en/main/
Apache License 2.0
8.02k stars 2.58k forks source link

Different test results from the same model when testing multiple times #3719

Closed bjzhb666 closed 3 months ago

bjzhb666 commented 3 months ago

I am using Segnext. I found that when I used the same model, the same batch size and set round_up=False in DefaultSampler. I have 1000 images and batch size is 1 for each GPU (8 GPUS in total).

But the results (IOU) are not the same. Is that a normal situation? What is the reason? No data augmentation during testing. image

LYKlyk commented 2 months ago

I also meet the same problem. How to solve it?

bjzhb666 commented 2 months ago

See https://github.com/open-mmlab/mmsegmentation/tree/main/configs/segnext

LYKlyk commented 2 months ago

I have tried this solution. However, it does not work! How to solve it? Thank you! @bjzhb666