How were the hyperparameters determined? Provide hyperparameters sweep range and option

[qwer1304]

How did you determine the hyperparameters for the different tasks?

DomainBed has an option to sweep the hyperparameters through some ranges.

1. It'd be helpful if your library also contained such a capability.
2. IMHO, it'd be helpful if you listed the ranges you've swept to arrive at hyperparameters values you currently use.

[thucbx99]

We follow the standard protocol in the corresponding literature to determine hyperparameters.

• For instance, in the domain generalization problem, DomainBed proposes 3 methods to select hyperparameters. Hence, we opt to use training-domain validation set (the first method).

It is difficult to give the precise range of hyperparameters. For algorithms with official implementations, we try to keep the parameters as consistent as possible to ensure optimality. And these parameters may be carefully tuned by the authors. Overall, we also follow the common protocal.

• For instance, we select learning rate (SGD optimizer) in [3e-5, 1e-4, 3e-4, 1e-3, 3e-3].

We will consider providing ranges in the documentations.