search

DerrickWang005 / CRIS.pytorch

An official PyTorch implementation of the CRIS paper
MIT License
242 stars 36 forks source link

IoU reported is oIoU or mIoU ? #12

Closed qiulesun closed 1 year ago

qiulesun commented 1 year ago

Nice work ! In terms of IoU reported in CRIS, the IoU is overall intersection-over-union (oIoU) or mean intersection-over-union (mIoU) metric? In the released code, the mIoU metric seems to be calculated for comparisons with SOTA in all tables in CRIS paper.

DerrickWang005 commented 1 year ago

mIoU

qiulesun commented 1 year ago

@DerrickWang005 As far as I know, current SOTAs, such as [1,2,3], mainly report oIoU value for comparisons. So do you consider providing corresponding oIoU values across all benchmark datasets?

[1] LAVT: Language-Aware Vision Transformer for Referring Image Segmentation, In CVPR 2022 [2] ReSTR: Convolution-free Referring Image Segmentation Using Transformers, In CVPR 2022 [3] Bottom-Up Shift and Reasoning for Referring Image Segmentation, In CVPR 2021