-
The list of Ryan's annotators is in the wg meeting notes:
https://docs.google.com/document/u/2/d/1q1UPz9I_Hzft6-sS24P2TVKq6Ov7ghp-LRyVLS9rfFo/edit
Background:
Before this batch, engineering wrote a…
-
Check https://docs.mlcommons.org/inference/benchmarks but found:
@ashwin @jdduke @codyaustun @badenh @koichishirahata
-
(python3-venv) aarch64_sh ~> cm run script --tags=run-mlperf,inference,_find-performance,_full,_r4.1 --model=dlrm_v2-99 --implementation=reference --framework=pytorch --category=datacenter…
-
### Describe the bug
The MLCubes getting generated (model or metrics) are always the same version, as evidenced by the following files (just search for the string `0.0.1`):
- https://github.com/ml…
-
We currently return:
```
"sha256": "https://github.com/mlcommons/croissant/issues/80"
```
See https://github.com/mlcommons/croissant/issues/80. cc @marcenacp
-
I followed the [document](https://docs.mlcommons.org/inference/benchmarks/image_classification/resnet50) to inference ResNet50, using MLCommons-Python -> edge -> Tensorflow -> CUDA -> Native
The comm…
-
Link: https://mlcommons.org/ai-safety/ai-safety-prompt-eoi/
-
-
Hello mlcommons team,
I want to run the "Automated command to run the benchmark via MLCommons CM" (from the example: https://github.com/mlcommons/inference/tree/master/language/llama2-70b), but I d…
-
## Overview
- "Croissant is a high-level format for machine learning datasets that brings together four rich layers."
- This issue tracks activities related to our collaboration with the Kaggle Tea…