p-lambda / wilds

A machine learning benchmark of in-the-wild distribution shifts, with data loaders, evaluators, and default models.
https://wilds.stanford.edu
MIT License
551 stars 128 forks source link

Oracle results for UDA tasks #142

Closed kiranchari closed 1 year ago

kiranchari commented 1 year ago

Hi,

Could you please share Oracle, i.e. training on labeled target domain, results for the Camelyon17 and iWildCAM datasets in "Extending the WILDS benchmark for unsupervised adaptation"? Oracle results for the other datasets would be appreciated too.

If Oracle results are not available, could you please share the commands that can be used to obtain them?

Thanks.

kiranchari commented 1 year ago

I found these results (ERM (fully-labeled)) in the paper.