Different results in the README page and the paper

facebookresearch / DomainBed

DomainBed is a suite to test domain generalization algorithms

MIT License

1.4k stars 297 forks source link

Different results in the README page and the paper #38

Closed shiliang26 closed 3 years ago

shiliang26 commented 3 years ago

Hi,

I may have missed something, but it seems what's reported in the "Current results" section in the README page is different from Table 4 in the original paper. I wonder has it been updated, and how?

Thank you!

lopezpaz commented 3 years ago

The last version of the paper is the one accepted in ICLR 2021 (https://openreview.net/forum?id=lQdXeXDoWtI), uses commit 7df6f06, and matches the results from the README.md file.

shiliang26 commented 3 years ago

Thanks for responding so quickly! You might wanna update the link in the README file though.

kowshikthopalli commented 3 years ago

sorry to open this again. There is quite a discrepancy in the results reported in arxiv version and the open review version atleast for VLCS and other datasets. Just to be clear, I will have to compare my results with openreview version itself correct?

lopezpaz commented 3 years ago

Openreview version for now, it is the latest. Thanks.