search

zygmuntz / hyperband

Tuning hyperparams fast with Hyperband
http://fastml.com/tuning-hyperparams-fast-with-hyperband/
Other
591 stars 75 forks source link

Understanding iterations vs runs #8

Closed yngtodd closed 7 years ago

yngtodd commented 7 years ago

Looking over the results from one of my runs, I am seeing both a number of iterations and a number of runs? Can you explain the difference between these two?

How would I go about setting up an experiment where there would be 50 pulls of the bandits? I assume that is setting the run parameter?

zygmuntz commented 7 years ago

A "run" refers to trying a configuration, running the model for a number of iterations. It's what you call a pull.

The total number of runs is controlled by hyperband's internal hyperparams, s and eta if memory serves.

See http://fastml.com/tuning-hyperparams-fast-with-hyperband/ for explanation of matters such as those two.