exception to the preview requirement of submitting again under available

mlcommons / training_policies

Issues related to MLPerf™ training policies, including rules and suggested changes

https://mlcommons.org/en/groups/training

Apache License 2.0

92 stars 66 forks source link

exception to the preview requirement of submitting again under available #323

Closed christ1ne closed 4 years ago

christ1ne commented 4 years ago

Intel submitted a preview result for minigo for under preview category. Considering minigo has been changed significantly, especially the run time, so I think it is reasonable not to require minigo submission again in this round as a mandatory requirement.

bitfort commented 4 years ago

SWG:

Our understanding is that the hardware is GA now; resubmitting for performance comparison in this particular case is not valid because the benchmark has changed so much.