-
### Describe the bug
The MLCubes getting generated (model or metrics) are always the same version, as evidenced by the following files (just search for the string `0.0.1`):
- https://github.com/ml…
-
In the inference/vision/classification_and_detection/setup.py
there is no package with the name **mlperf_loadgen**?
Instead it is **mlcommons_loadgen.**
-
FAILED plugins/validation_tests/test_object_creation.py::test_all_suts_can_evaluate[gemma-9b-it-hf] - modelgauge.secret_values.MissingSecretValues: Missing the following secrets:
scope='hugging_face' …
-
The MLCommons Task Force on Automation and Reproducibility has increasing number of requests to extend [MLCommons Modular C++ inference library (MIL)](https://github.com/mlcommons/ck/blob/master/cm-ml…
-
There are some inaccuracies in the information that the script generates, some more important than others I believe. For example, it sets our OS to ubuntu since that is the operating system inside the…
-
Trying to run offline retinanet in a container with one Nvidia GPU:
cm run script --tags=run-mlperf,inference,_find-performance,_full,_r4.1-dev --model=retinanet --implementation=nvidia …
-
## Overview
- "Croissant is a high-level format for machine learning datasets that brings together four rich layers."
- This issue tracks activities related to our collaboration with the Kaggle Tea…
-
The list of Ryan's annotators is in the wg meeting notes:
https://docs.google.com/document/u/2/d/1q1UPz9I_Hzft6-sS24P2TVKq6Ov7ghp-LRyVLS9rfFo/edit
Background:
Before this batch, engineering wrote a…
-
we can get them from the main inference group: https://github.com/mlcommons/inference/
-
We currently return:
```
"sha256": "https://github.com/mlcommons/croissant/issues/80"
```
See https://github.com/mlcommons/croissant/issues/80. cc @marcenacp