search

facebookresearch / DomainBed

DomainBed is a suite to test domain generalization algorithms
MIT License
1.42k stars 298 forks source link

What **query** means in the paper? #117

Closed VoiceBeer closed 2 years ago

VoiceBeer commented 2 years ago

Hi, thanks for your brilliant work! The questions raised are thought-provoking, and the standards help the game be rigorous!

In Section 3.1, I'm wondering what query means in oracle model selection method? To me, one query seems like a random search to find the fit hyperparameters, but do you make queries in the other two model selection methods?

Many thanks to your work and have a good day :>

lopezpaz commented 2 years ago

One query = one hparam configuration that we try. Oracle is only different in the way it chooses the best model (looking at validation set drawn from the test domain).

VoiceBeer commented 1 year ago

Hi David@lopezpaz , thx for your reply! Have a good day xD