lixiaotong97 / DSU

[ICLR 2022] Official pytorch implementation of "Uncertainty Modeling for Out-of-Distribution Generalization" in International Conference on Learning Representations (ICLR) 2022.
141 stars 16 forks source link

About the experiment results #2

Closed Baymine closed 2 years ago

Baymine commented 2 years ago

Did you use the best results (show in the output log) as your final results? If not, would you please tell me how did you get the results reported in the paper? Thank you.

lixiaotong97 commented 2 years ago

We use the results of the last checkpoint by default. Considering the dataset is relatively small and thus suffers fluctuations, such as PACS, we show the results with the best performances. There can be some fluctuations in performances due to the different environments, the relative improvement should be significant regardless of these.

Best of wishes.