mlcommons / inference_policies

Issues related to MLPerf™ Inference policies, including rules and suggested changes
https://mlcommons.org/en/groups/inference/
Apache License 2.0
56 stars 52 forks source link

Early stopping rule change #237

Closed ckstanton closed 2 years ago

ckstanton commented 2 years ago

Adds the rule change for the early stopping criterion, including a detailed appendix with relevant calculations and discussion.

I removed the appendix discussing choice of minimum query count, since this is no longer relevant with early stopping.

github-actions[bot] commented 2 years ago

MLCommons CLA bot All contributors have signed the MLCommons CLA ✍️ ✅