Hi, I have run the test codes using the command ./dist_test.sh /path/to/config /path/to/checkpoint_file 8 --eval mIoU from https://github.com/Visual-Attention-Network/VAN-Segmentation. In my run, the combination of VAN-Tiny and Semantic FPN is used, and the output of mIoU is 38.65 instead of 38.5 that is reported on the website https://github.com/Visual-Attention-Network/VAN-Segmentation. By checking the testing codes, I have noticed the validation data from ADEChallengeData2016/images/validation is loaded by the program. To run the test codes on the test data, I also downloaded the file "release_test.zip" of ADE20K from the website https://github.com/open-mmlab/mmsegmentation/tree/v0.26.0/. However, the unzipped release_test does not contain any annotation files with png as extentsion name.
I have a few questions：
(1) I wonder if the number 38.5 on the website https://github.com/Visual-Attention-Network/VAN-Segmentation is generated on data in the file folder ADEChallengeData2016/images/validation?
or (2) How could I get the annotation labels of the test data of ADE20K.
Many thanks in advance.
Hi, I have run the test codes using the command ./dist_test.sh /path/to/config /path/to/checkpoint_file 8 --eval mIoU from https://github.com/Visual-Attention-Network/VAN-Segmentation. In my run, the combination of VAN-Tiny and Semantic FPN is used, and the output of mIoU is 38.65 instead of 38.5 that is reported on the website https://github.com/Visual-Attention-Network/VAN-Segmentation. By checking the testing codes, I have noticed the validation data from ADEChallengeData2016/images/validation is loaded by the program. To run the test codes on the test data, I also downloaded the file "release_test.zip" of ADE20K from the website https://github.com/open-mmlab/mmsegmentation/tree/v0.26.0/. However, the unzipped release_test does not contain any annotation files with png as extentsion name. I have a few questions： (1) I wonder if the number 38.5 on the website https://github.com/Visual-Attention-Network/VAN-Segmentation is generated on data in the file folder ADEChallengeData2016/images/validation? or (2) How could I get the annotation labels of the test data of ADE20K. Many thanks in advance.