search

mlcommons / inference_policies

Issues related to MLPerf™ Inference policies, including rules and suggested changes
https://mlcommons.org/en/groups/inference/
Apache License 2.0
55 stars 52 forks source link

Add GPT-J rules #275

Closed pgmpablo157321 closed 1 year ago

github-actions[bot] commented 1 year ago

MLCommons CLA bot All contributors have signed the MLCommons CLA ✍️ ✅

rnaidu02 commented 1 year ago

@pgmpablo157321 Accuracy and latency details look good. Can you add beam=4 also to the details in the rules document for GPT-J?

pgmpablo157321 commented 1 year ago

@rnaidu02 Does this look ok to you?https://github.com/mlcommons/inference_policies/blob/87b3958b2df37b704a6397a5c8ee6761e90aeeb9/inference_rules.adoc#additional-inference-parameters

rnaidu02 commented 1 year ago

LGTM