-
I installed CM following the guide in https://docs.mlcommons.org/ck/install/ successfully
and then refer to https://docs.mlcommons.org/inference/benchmarks/language/bert/ to run the scripts as belo…
-
There are several topics we need to become familiar with in the project. Most items are covered in the overleaf paper, but to list out our source material to become familiar with:
- [Earthquake No…
rknuu updated
2 years ago
-
I vote to move to `0.1.0` after this PR gets merged rather than `0.0.20`, since it is going to be a pretty big API change.
_Originally posted by @sarthakpati in https://github.com/mlc…
-
> Please provide a detailed description of your question or the information you seek.
i have follow your https://github.com/mlcommons/chakra/blob/main/USER_GUIDE.md to install the chakra.
however …
-
######
Below error in datacenter category, llama2-70b-99.9 model, Offline Scenario in docker container and used this command script.
cm run script --tags=run-mlperf,inference,_find-performance,_fu…
-
AssertionError: Some of the target inference cases were found: {'case_00111', 'case_00400', 'case_00185', 'case_00052', 'case_00065', 'case_00000', 'case_00084', 'case_00076', 'case_00157', 'case_0004…
-
Check all logfiles generated by the Rivanna deployment of CloudMask. The logfiles can be found here: https://github.com/laszewsk/mlcommons/tree/main/benchmarks/cloudmask/target/logs
-
Hello mlcroissant community,
I am looking for support of CoNLL format, which is widely used in NLP domain. Please see here for a long-existing StackOverflow thread explaining the format.
https://s…
-
e.g., https://docs.scipy.org/doc/scipy/reference/generated/scipy.stats.qmc.Halton.html#scipy.stats.qmc.Halton
This is likely to be better maintained than the MLCommons code.
-
Hello mlcommons team,
I want to run the "Automated command to run the benchmark via MLCommons CM" (from the example: https://github.com/mlcommons/inference/tree/master/language/llama2-70b), but I a…