HP Table

[bitfort]

Notes for the HP Table (and more general hyper parameter effort).

[bitfort]

SWG Notes:

An important concept to work through is throughput versus time-to-converge.

The HP Lookup tables would be indexed by batch size and numerics.

(1) HP Lookup Table

• We make a table where you plug in your batch size & numerics and look up the HPs you should be using.
• All other MLPerf rules apply

(2) HP Lookup table to validate submissions

• The HP table has expected epochs, we use this to review submissions

(3) HP Look up table to compute score

• The HP table has expected epochs,
• We use expected epochs with throughput to compute the MLPerf score