issues
search
mlcommons
/
inference_policies
Issues related to MLPerf™ Inference policies, including rules and suggested changes
https://mlcommons.org/en/groups/inference/
Apache License 2.0
54
stars
52
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
Fix MoE details
#298
pgmpablo157321
opened
2 weeks ago
1
Fix typo in Mixtral accuracy
#297
pgmpablo157321
closed
2 weeks ago
3
fix: correct moe OSL in inference_rules.adoc
#296
viraatc
opened
3 weeks ago
3
Add Mixtral-8x7B rules
#295
pgmpablo157321
closed
3 weeks ago
2
Add automotive benchmark rules
#294
rod409
closed
1 month ago
2
Specification for Language Modelling
#293
jubueche
opened
5 months ago
0
Update SDXL Egress stat
#292
nvyihengz
closed
5 months ago
2
Fix table format for SDXL and add SDXL bandwidth formula
#291
nvyihengz
closed
5 months ago
2
Peer Review Rules
#290
mrmhodak
opened
5 months ago
8
Update llama2 accuracy in the rule
#289
nvzhihanj
closed
5 months ago
1
Added StableDiffusionXL (SDXL) benchmark to rules
#288
ahmadki
closed
6 months ago
1
Add and revise rules related to llama2
#287
nvzhihanj
closed
6 months ago
1
Modify the min query constraint for the Offline scenario
#286
arjunsuresh
opened
7 months ago
1
Update the open dataset requirement
#285
psyhtest
closed
7 months ago
3
updating audit rules to ensure fair voting
#284
itayhubara
closed
5 months ago
6
Update non-random audit rules
#283
mrmhodak
closed
9 months ago
4
Update inference_retraining_rules.adoc
#282
bitfort
closed
9 months ago
1
Remove obsolete row for 3DUNet from egress bandwidth table
#281
nv-jinhosuh
closed
8 months ago
3
Update inference_rules for network division
#280
liorkhe
closed
11 months ago
3
Is Ethernet point-to-point allowed in Network division of 3.1?
#279
nv-ananjappa
closed
11 months ago
5
LLM Benchmark Decoding Algorithm Rules Proposal.
#278
yyetim
closed
12 months ago
7
Update inference_rules.adoc
#277
arjunsuresh
closed
1 year ago
1
Update power_measurement.adoc
#276
s-idgunji
closed
1 year ago
1
Add GPT-J rules
#275
pgmpablo157321
closed
1 year ago
4
Update benchmark carrying capacity
#274
mrasquinha-g
closed
9 months ago
3
Add DLRMv2 rules
#273
pgmpablo157321
closed
1 year ago
1
Update inference_rules.adoc
#272
arjunsuresh
closed
1 year ago
2
Update license header
#271
nathanw-mlc
closed
1 year ago
1
Encouraging results density
#270
psyhtest
opened
1 year ago
2
Rules update for auditor selection timeline
#269
mrasquinha-g
closed
1 year ago
7
argmax for top1
#268
dalvikus
opened
1 year ago
1
Results Table Power Precision
#267
bitfort
closed
1 year ago
1
Clarification on reading Quality Target
#266
bitfort
closed
1 year ago
2
Inference Rules Updates for multiple Nodes
#265
liorkhe
closed
1 year ago
2
Update inference_rules.adoc
#264
liorkhe
closed
1 year ago
2
Update to the Network Division Rules
#263
liorkhe
closed
1 year ago
1
Source code reqs for Network Division
#262
DilipSequeira
closed
1 year ago
3
Random seeds to be released four weeks before
#261
rnaidu02
closed
1 year ago
1
Rule for post-publication audit
#260
nv-ananjappa
closed
1 year ago
2
Update inference_rules for Closed pruning support
#259
mgoin
closed
1 year ago
1
Add audit guidelines
#258
nvzhihanj
closed
1 year ago
7
Random audit exclusion
#257
arjunsuresh
closed
1 year ago
2
3D-UNet ingress/egress BW calculation update after sample set change
#256
nv-jinhosuh
closed
1 year ago
1
Update inference_rules.adoc
#255
arjunsuresh
closed
1 year ago
10
Update model name to Retinanet
#254
pgmpablo157321
closed
1 year ago
1
Delete submission_checklist.md
#253
tjablin
closed
1 year ago
1
Restricted retraining is allowed post-0.7
#252
tjablin
closed
1 year ago
1
Update mAP
#251
pgmpablo157321
closed
2 years ago
1
Update inference_rules.adoc
#250
rnaidu02
closed
2 years ago
1
Need to clean up Inference rules.adoc with recent changes for Object detector
#249
rnaidu02
closed
1 year ago
2
Next