-
```
[Benchmarking] Failed to calculate metrics in executing recipe due to error: The api_key client option must be set either by passing api_key to the client or by setting the TOGETHER_API_KEY envir…
-
hi neal
just saw this repo pop up in my gh feed
i was wondering if youd be interested to explore synergies w croissant? https://github.com/mlcommons/croissant
we have also started exploring a…
-
Run the below cm commands for several times and always failed at the same place:
(cm) tomcat@tomcat-Dove-Product:~$ cm run script --tags=run-mlperf,inference,_find-performance,_full,_r4.1-dev \
…
-
(python3-venv) aarch64_sh ~> cm run script --tags=run-mlperf,inference,_find-performance,_full,_r4.1 --model=dlrm_v2-99 --implementation=reference --framework=pytorch --category=datacenter…
-
-
Check https://docs.mlcommons.org/inference/benchmarks but found:
@ashwin @jdduke @codyaustun @badenh @koichishirahata
-
I followed the [document](https://docs.mlcommons.org/inference/benchmarks/image_classification/resnet50) to inference ResNet50, using MLCommons-Python -> edge -> Tensorflow -> CUDA -> Native
The comm…
-
Hello mlcommons team,
I want to run the "Automated command to run the benchmark via MLCommons CM" (from the example: https://github.com/mlcommons/inference/tree/master/language/llama2-70b), but I d…
-
According to `https://github.com/mlcommons/croissant/blob/main/docs/croissant.ttl`, The croissant namespace is ``
However, `http://mlcommons.org/croissant/` redirects to `https://mlcommons.org/work…
-
I want to reproduce nvidia-bert https://github.com/mlcommons/ck/blob/master/docs/mlperf/inference/bert/README_nvidia.md#build-nvidia-docker-container-from-31-inference-round
when I run "cm docker scr…