slds-lmu / yahpo_gym

Surrogate benchmarks for HPO problems
26 stars 3 forks source link

R BenchmarkSet::get_objective seems to ignore seed? #53

Closed mb706 closed 1 year ago

mb706 commented 2 years ago

seems to be dangerous to suggest that giving a seed will make experiments reproducible when it is actually ignored

https://github.com/slds-lmu/yahpo_gym/blob/6d5a988dae972884c847b81529c73965421583b4/yahpo_gym_r/R/BenchmarkSet.R#L115-L133

pfistfl commented 1 year ago

Should be fixed now