search

mlcommons / inference_policies

Issues related to MLPerf™ Inference policies, including rules and suggested changes
https://mlcommons.org/en/groups/inference/
Apache License 2.0
55 stars 52 forks source link

Update benchmark carrying capacity #274

Closed mrasquinha-g closed 10 months ago

mrasquinha-g commented 1 year ago

Update rules to indicate carrying capacity.

github-actions[bot] commented 1 year ago

MLCommons CLA bot All contributors have signed the MLCommons CLA ✍️ ✅

psyhtest commented 1 year ago

Each suite has a carrying capacity of 10 benchmarks i.e at any point in time, the number of benchmarks will not exceed 10.

Theoretically, the Datacenter and Edge benchmarks could be completely disjoint, so the number of benchmarks would be 20.

mrmhodak commented 1 year ago

Needs to be clarified