search

mlcommons / inference_policies

Issues related to MLPerf™ Inference policies, including rules and suggested changes
https://mlcommons.org/en/groups/inference/
Apache License 2.0
55 stars 52 forks source link

Rules update for auditor selection timeline #269

Closed mrasquinha-g closed 1 year ago

mrasquinha-g commented 1 year ago

As discussed in the working group on 2/28. Updating the rules to restrict the time for auditor selection.

github-actions[bot] commented 1 year ago

MLCommons CLA bot All contributors have signed the MLCommons CLA ✍️ ✅

DilipSequeira commented 1 year ago

What do we want to do in the case where the committee fail to find an auditor?

DilipSequeira commented 1 year ago

Also, it might be better to say "28 days", just because the existing timeline is framed in units of days.

mrasquinha-g commented 1 year ago

As discussed in the WG meeting the results review committee will have a list of potential auditors to pick from, minimizing the chances of such a situtation.

In the case that "no auditor" can be identified within 28 days and the audit process exceeds three months. The submitter can request for an audit to be cancelled.

DilipSequeira commented 1 year ago

In the case that "no auditor" can be identified within 28 days and the audit process exceeds three months. The submitter can request for an audit to be cancelled.

Thanks Mitchelle. Can you amend the PR accordingly?

mrasquinha-g commented 1 year ago

Updated. Thanks for the review!

DilipSequeira commented 1 year ago

lgtm but it seems I'm not an approving reviewer.