[Q] Partial Grid Search using sweep config

[meghbhalerao]

Is there a way to specify partial grid search in the sweep yaml file? By partial, what I mean is - hyperparameter1 - [v1, v2, v3, v4, v5] - there are values for hyper parameter 1 that I want to search over. hyperparameter2 - [x1, x2, x3, x4, x5, x6, x7, x8, x9, x10] hp2 - [y1,y2,y3,y4] but say I want to only run combinations of v1 with x1, x2 - v2 with x3, x4 and so on, and all combinations of hp3

is there a way of specifying this in the sweep config? I think this can be a pretty useful feature if we know that in our use case some combinations of hyperparameters do not make sense.

Thanks for your time and please let me know if anything is unclear!

[nate-wandb]

hI @meghbhalerao, this is not currently available but we have a feature request for conditional parameters in sweeps if you would like me to add you to the request?

Basically it would select parameters based on the selection of other parameters so if hp1 was V1 then you could set conditional logic to not use certain values for hp2.

[nate-wandb]

Hi @meghbhalerao, I wanted to follow up and see if you think that feature request would solve your use case?

[meghbhalerao]

Hi nate Yes I think the feature request you mentioned will be helpful and it would solve the thing I need. Thanks !

On Sat, 17 Jun 2023, 01:11 nate-wandb, @.***> wrote:

Hi @meghbhalerao https://github.com/meghbhalerao, I wanted to follow up and see if you think that feature request would solve your use case?

— Reply to this email directly, view it on GitHub https://github.com/wandb/wandb/issues/5698#issuecomment-1595201057, or unsubscribe https://github.com/notifications/unsubscribe-auth/AH5KGEGED7AV6WHNK66XITDXLSZHDANCNFSM6AAAAAAZBLBV3A . You are receiving this because you were mentioned.Message ID: @.***>

[nate-wandb]

Ok, I can follow up once we are able to implement this. Thank you!