WangChangqi98 / CSS

[ICCV'23] Space Engage: Collaborative Space Supervision for Contrastive-based Semi-Supervised Semantic Segmentation
33 stars 3 forks source link

About the split #10

Closed Hugo-cell111 closed 1 year ago

Hugo-cell111 commented 1 year ago

Hi! Could you please provide txt files of the labeled and unlabeled data split? Thanks!

WangChangqi98 commented 1 year ago

They are the same with those in U2PL, you can download them from their repo. Or I will update data split tomorrow, I am not available with my server now, sorry.

Hugo-cell111 commented 1 year ago

Don't worry about it, I will go to their repo. Thanks!

Hugo-cell111 commented 1 year ago

Hi! Sorry to reopen the issue. You say you use the same split as U2PL, since many works such as UniMatch, iMAS, AugSeg find the split used in U2PL is unfair and reproduce U2PL, have you tried to reproduce your work with the split from UniMatch? Using the split from UniMatch will naturally boost the mIOU performance. Thanks!

WangChangqi98 commented 1 year ago

Sorry for my late reply! UniMatch and AugSeg are published in CVPR 2023 (released in March), so I have not read them when I submitted my paper to ICCV (8th March). I did not consider a lot about the split in this work, and I simply follow the U2PL. By the way, I think it is not very essential to over consider the choice of split, the motivation of your work and the ablations are more important. If you have enough time and computing resources, you can try to use different splits when compared to different SOTA approaches. It is more fair. However, if you have difficulty to do that, I think it is OK to use the split which can achieve best performance.

Hugo-cell111 commented 1 year ago

Yes, you are right! Plus in your work you don't compare those who use different splits as U2PL, so your comparison towards the baseline is fair and correct. Anyway, I have no more doubt. Thank you for your answer!