Discrepancy Between Training Log and Paper Results for Cityscapes -> ACDC

w1oves / Rein

[CVPR 2024] Official implement of <Stronger, Fewer, & Superior: Harnessing Vision Foundation Models for Domain Generalized Semantic Segmentation>

https://zxwei.site/rein

GNU General Public License v3.0

250 stars 21 forks source link

Discrepancy Between Training Log and Paper Results for Cityscapes -> ACDC #52

Closed ysj9909 closed 3 months ago

ysj9909 commented 3 months ago

Hello! The training log for cityscapes -> ACDC shows a performance of 73.41, but the paper mentions 77.6. Could you please explain this discrepancy? Thank you!

w1oves commented 3 months ago

In log, the metric is on the val set. The metrics in the paper are obtained on the test set. This is clearly stated in the paper, and you can find rein's results on acdc's official website.

w1oves commented 3 months ago

https://acdc.vision.ee.ethz.ch/submissions/65b6848187f1a5171cf44c34