mlcommons / training_policies

Issues related to MLPerf™ training policies, including rules and suggested changes
https://mlcommons.org/en/groups/training
Apache License 2.0
93 stars 66 forks source link

Increase GPT3 init time limit #522

Closed nv-rborkar closed 1 year ago

nv-rborkar commented 1 year ago

Proposal to increase model init time for GPT3 benchmark to 60 minutes for Closed Division owing to the large memory footprint of initial checkpoints.

github-actions[bot] commented 1 year ago

MLCommons CLA bot All contributors have signed the MLCommons CLA ✍️ ✅

erichan1 commented 1 year ago

Approved by WG. All submitters who use > 30 min should show that it runs in < 30 min in v3.1. We will say mean things otherwise.